Logging to logs/AntFH-v0/exp-16/fkl/2024_08_10_23_06_12
--2024-08-10 23:07:17.377700 UTC--
| Itration            | 0        |
| Real Det Return     | 809      |
| Real Sto Return     | -58.8    |
| Reward Loss         | 3.01e+05 |
| Running Env Steps   | 0        |
| Running Forward KL  | 152      |
| Running Reverse KL  | 2.34e+03 |
| Running Update Time | 0        |
----------------------------------
--2024-08-10 23:08:30.396351 UTC--
| Itration            | 1        |
| Real Det Return     | 888      |
| Real Sto Return     | -155     |
| Reward Loss         | 6.96e+04 |
| Running Env Steps   | 5000     |
| Running Forward KL  | 144      |
| Running Reverse KL  | 1.9e+03  |
| Running Update Time | 1        |
----------------------------------
--2024-08-10 23:09:43.146012 UTC--
| Itration            | 2        |
| Real Det Return     | 836      |
| Real Sto Return     | -147     |
| Reward Loss         | 1.57e+04 |
| Running Env Steps   | 10000    |
| Running Forward KL  | 149      |
| Running Reverse KL  | 2.27e+03 |
| Running Update Time | 2        |
----------------------------------
--2024-08-10 23:10:57.271542 UTC--
| Itration            | 3        |
| Real Det Return     | 818      |
| Real Sto Return     | -164     |
| Reward Loss         | 8.06e+03 |
| Running Env Steps   | 15000    |
| Running Forward KL  | 145      |
| Running Reverse KL  | 1.97e+03 |
| Running Update Time | 3        |
----------------------------------
--2024-08-10 23:12:10.169550 UTC---
| Itration            | 4         |
| Real Det Return     | 575       |
| Real Sto Return     | -117      |
| Reward Loss         | -1.03e+05 |
| Running Env Steps   | 20000     |
| Running Forward KL  | 148       |
| Running Reverse KL  | 2.23e+03  |
| Running Update Time | 4         |
-----------------------------------
--2024-08-10 23:13:24.811889 UTC---
| Itration            | 5         |
| Real Det Return     | 547       |
| Real Sto Return     | -136      |
| Reward Loss         | -1.54e+05 |
| Running Env Steps   | 25000     |
| Running Forward KL  | 141       |
| Running Reverse KL  | 1.45e+03  |
| Running Update Time | 5         |
-----------------------------------
--2024-08-10 23:14:41.367388 UTC---
| Itration            | 6         |
| Real Det Return     | 457       |
| Real Sto Return     | -200      |
| Reward Loss         | -2.76e+05 |
| Running Env Steps   | 30000     |
| Running Forward KL  | 147       |
| Running Reverse KL  | 2.06e+03  |
| Running Update Time | 6         |
-----------------------------------
--2024-08-10 23:15:56.576306 UTC---
| Itration            | 7         |
| Real Det Return     | 641       |
| Real Sto Return     | -208      |
| Reward Loss         | -4.18e+05 |
| Running Env Steps   | 35000     |
| Running Forward KL  | 142       |
| Running Reverse KL  | 1.55e+03  |
| Running Update Time | 7         |
-----------------------------------
--2024-08-10 23:17:11.515925 UTC---
| Itration            | 8         |
| Real Det Return     | 655       |
| Real Sto Return     | -162      |
| Reward Loss         | -4.05e+05 |
| Running Env Steps   | 40000     |
| Running Forward KL  | 142       |
| Running Reverse KL  | 2.02e+03  |
| Running Update Time | 8         |
-----------------------------------
--2024-08-10 23:18:26.874166 UTC---
| Itration            | 9         |
| Real Det Return     | 723       |
| Real Sto Return     | -210      |
| Reward Loss         | -3.95e+05 |
| Running Env Steps   | 45000     |
| Running Forward KL  | 144       |
| Running Reverse KL  | 1.66e+03  |
| Running Update Time | 9         |
-----------------------------------
--2024-08-10 23:19:43.077508 UTC---
| Itration            | 10        |
| Real Det Return     | 559       |
| Real Sto Return     | -186      |
| Reward Loss         | -4.31e+05 |
| Running Env Steps   | 50000     |
| Running Forward KL  | 139       |
| Running Reverse KL  | 894       |
| Running Update Time | 10        |
-----------------------------------
--2024-08-10 23:20:59.277752 UTC---
| Itration            | 11        |
| Real Det Return     | 767       |
| Real Sto Return     | -160      |
| Reward Loss         | -6.64e+05 |
| Running Env Steps   | 55000     |
| Running Forward KL  | 141       |
| Running Reverse KL  | 853       |
| Running Update Time | 11        |
-----------------------------------
--2024-08-10 23:22:14.454238 UTC---
| Itration            | 12        |
| Real Det Return     | 638       |
| Real Sto Return     | -190      |
| Reward Loss         | -6.14e+05 |
| Running Env Steps   | 60000     |
| Running Forward KL  | 143       |
| Running Reverse KL  | 1.9e+03   |
| Running Update Time | 12        |
-----------------------------------
--2024-08-10 23:23:30.600912 UTC---
| Itration            | 13        |
| Real Det Return     | 598       |
| Real Sto Return     | -177      |
| Reward Loss         | -8.03e+05 |
| Running Env Steps   | 65000     |
| Running Forward KL  | 143       |
| Running Reverse KL  | 1.39e+03  |
| Running Update Time | 13        |
-----------------------------------
--2024-08-10 23:24:51.013342 UTC---
| Itration            | 14        |
| Real Det Return     | 674       |
| Real Sto Return     | -170      |
| Reward Loss         | -8.29e+05 |
| Running Env Steps   | 70000     |
| Running Forward KL  | 142       |
| Running Reverse KL  | 1.08e+03  |
| Running Update Time | 14        |
-----------------------------------
--2024-08-10 23:26:16.001114 UTC---
| Itration            | 15        |
| Real Det Return     | 695       |
| Real Sto Return     | -159      |
| Reward Loss         | -1.01e+06 |
| Running Env Steps   | 75000     |
| Running Forward KL  | 140       |
| Running Reverse KL  | 955       |
| Running Update Time | 15        |
-----------------------------------
--2024-08-10 23:27:43.406781 UTC---
| Itration            | 16        |
| Real Det Return     | 689       |
| Real Sto Return     | -214      |
| Reward Loss         | -9.76e+05 |
| Running Env Steps   | 80000     |
| Running Forward KL  | 145       |
| Running Reverse KL  | 1.02e+03  |
| Running Update Time | 16        |
-----------------------------------
--2024-08-10 23:29:10.931757 UTC---
| Itration            | 17        |
| Real Det Return     | 584       |
| Real Sto Return     | -210      |
| Reward Loss         | -9.89e+05 |
| Running Env Steps   | 85000     |
| Running Forward KL  | 147       |
| Running Reverse KL  | 949       |
| Running Update Time | 17        |
-----------------------------------
--2024-08-10 23:30:37.648508 UTC---
| Itration            | 18        |
| Real Det Return     | 753       |
| Real Sto Return     | -193      |
| Reward Loss         | -1.17e+06 |
| Running Env Steps   | 90000     |
| Running Forward KL  | 145       |
| Running Reverse KL  | 1.08e+03  |
| Running Update Time | 18        |
-----------------------------------
--2024-08-10 23:32:06.470487 UTC---
| Itration            | 19        |
| Real Det Return     | 586       |
| Real Sto Return     | -221      |
| Reward Loss         | -1.23e+06 |
| Running Env Steps   | 95000     |
| Running Forward KL  | 144       |
| Running Reverse KL  | 790       |
| Running Update Time | 19        |
-----------------------------------
--2024-08-10 23:33:35.261268 UTC---
| Itration            | 20        |
| Real Det Return     | 752       |
| Real Sto Return     | -242      |
| Reward Loss         | -1.31e+06 |
| Running Env Steps   | 100000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 1.11e+03  |
| Running Update Time | 20        |
-----------------------------------
--2024-08-10 23:35:03.164063 UTC--
| Itration            | 21       |
| Real Det Return     | 681      |
| Real Sto Return     | -201     |
| Reward Loss         | -1.3e+06 |
| Running Env Steps   | 105000   |
| Running Forward KL  | 143      |
| Running Reverse KL  | 1.47e+03 |
| Running Update Time | 21       |
----------------------------------
--2024-08-10 23:36:30.267464 UTC---
| Itration            | 22        |
| Real Det Return     | 772       |
| Real Sto Return     | -182      |
| Reward Loss         | -1.46e+06 |
| Running Env Steps   | 110000    |
| Running Forward KL  | 142       |
| Running Reverse KL  | 1.32e+03  |
| Running Update Time | 22        |
-----------------------------------
--2024-08-10 23:37:58.787043 UTC---
| Itration            | 23        |
| Real Det Return     | 799       |
| Real Sto Return     | -235      |
| Reward Loss         | -1.51e+06 |
| Running Env Steps   | 115000    |
| Running Forward KL  | 142       |
| Running Reverse KL  | 1.22e+03  |
| Running Update Time | 23        |
-----------------------------------
--2024-08-10 23:39:26.092028 UTC---
| Itration            | 24        |
| Real Det Return     | 843       |
| Real Sto Return     | -154      |
| Reward Loss         | -1.82e+06 |
| Running Env Steps   | 120000    |
| Running Forward KL  | 142       |
| Running Reverse KL  | 1.49e+03  |
| Running Update Time | 24        |
-----------------------------------
--2024-08-10 23:40:55.336541 UTC---
| Itration            | 25        |
| Real Det Return     | 719       |
| Real Sto Return     | -195      |
| Reward Loss         | -1.54e+06 |
| Running Env Steps   | 125000    |
| Running Forward KL  | 143       |
| Running Reverse KL  | 915       |
| Running Update Time | 25        |
-----------------------------------
--2024-08-10 23:42:25.300300 UTC---
| Itration            | 26        |
| Real Det Return     | 699       |
| Real Sto Return     | -232      |
| Reward Loss         | -1.71e+06 |
| Running Env Steps   | 130000    |
| Running Forward KL  | 143       |
| Running Reverse KL  | 1.05e+03  |
| Running Update Time | 26        |
-----------------------------------
--2024-08-10 23:43:54.000334 UTC---
| Itration            | 27        |
| Real Det Return     | 722       |
| Real Sto Return     | -177      |
| Reward Loss         | -1.73e+06 |
| Running Env Steps   | 135000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 795       |
| Running Update Time | 27        |
-----------------------------------
--2024-08-10 23:45:22.641061 UTC---
| Itration            | 28        |
| Real Det Return     | 675       |
| Real Sto Return     | -197      |
| Reward Loss         | -2.03e+06 |
| Running Env Steps   | 140000    |
| Running Forward KL  | 141       |
| Running Reverse KL  | 1.55e+03  |
| Running Update Time | 28        |
-----------------------------------
--2024-08-10 23:46:52.950272 UTC---
| Itration            | 29        |
| Real Det Return     | 751       |
| Real Sto Return     | -184      |
| Reward Loss         | -1.94e+06 |
| Running Env Steps   | 145000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 441       |
| Running Update Time | 29        |
-----------------------------------
--2024-08-10 23:48:22.554936 UTC---
| Itration            | 30        |
| Real Det Return     | 763       |
| Real Sto Return     | -189      |
| Reward Loss         | -1.92e+06 |
| Running Env Steps   | 150000    |
| Running Forward KL  | 144       |
| Running Reverse KL  | 1.16e+03  |
| Running Update Time | 30        |
-----------------------------------
--2024-08-10 23:49:52.550818 UTC---
| Itration            | 31        |
| Real Det Return     | 608       |
| Real Sto Return     | -206      |
| Reward Loss         | -2.17e+06 |
| Running Env Steps   | 155000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 1.09e+03  |
| Running Update Time | 31        |
-----------------------------------
--2024-08-10 23:51:22.664178 UTC---
| Itration            | 32        |
| Real Det Return     | 707       |
| Real Sto Return     | -158      |
| Reward Loss         | -2.13e+06 |
| Running Env Steps   | 160000    |
| Running Forward KL  | 142       |
| Running Reverse KL  | 879       |
| Running Update Time | 32        |
-----------------------------------
--2024-08-10 23:52:52.845029 UTC---
| Itration            | 33        |
| Real Det Return     | 731       |
| Real Sto Return     | -229      |
| Reward Loss         | -2.35e+06 |
| Running Env Steps   | 165000    |
| Running Forward KL  | 143       |
| Running Reverse KL  | 1.71e+03  |
| Running Update Time | 33        |
-----------------------------------
--2024-08-10 23:54:24.714368 UTC---
| Itration            | 34        |
| Real Det Return     | 715       |
| Real Sto Return     | -221      |
| Reward Loss         | -2.24e+06 |
| Running Env Steps   | 170000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 437       |
| Running Update Time | 34        |
-----------------------------------
--2024-08-10 23:55:54.547836 UTC--
| Itration            | 35       |
| Real Det Return     | 786      |
| Real Sto Return     | -209     |
| Reward Loss         | -2.7e+06 |
| Running Env Steps   | 175000   |
| Running Forward KL  | 143      |
| Running Reverse KL  | 1.97e+03 |
| Running Update Time | 35       |
----------------------------------
--2024-08-10 23:57:27.170697 UTC---
| Itration            | 36        |
| Real Det Return     | 828       |
| Real Sto Return     | -241      |
| Reward Loss         | -2.46e+06 |
| Running Env Steps   | 180000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 673       |
| Running Update Time | 36        |
-----------------------------------
--2024-08-10 23:58:58.092200 UTC---
| Itration            | 37        |
| Real Det Return     | 754       |
| Real Sto Return     | -163      |
| Reward Loss         | -2.61e+06 |
| Running Env Steps   | 185000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 339       |
| Running Update Time | 37        |
-----------------------------------
--2024-08-11 00:00:30.054613 UTC---
| Itration            | 38        |
| Real Det Return     | 755       |
| Real Sto Return     | -212      |
| Reward Loss         | -2.69e+06 |
| Running Env Steps   | 190000    |
| Running Forward KL  | 143       |
| Running Reverse KL  | 650       |
| Running Update Time | 38        |
-----------------------------------
--2024-08-11 00:02:03.774517 UTC---
| Itration            | 39        |
| Real Det Return     | 860       |
| Real Sto Return     | -249      |
| Reward Loss         | -2.62e+06 |
| Running Env Steps   | 195000    |
| Running Forward KL  | 141       |
| Running Reverse KL  | 723       |
| Running Update Time | 39        |
-----------------------------------
--2024-08-11 00:03:36.853999 UTC---
| Itration            | 40        |
| Real Det Return     | 729       |
| Real Sto Return     | -220      |
| Reward Loss         | -2.88e+06 |
| Running Env Steps   | 200000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 363       |
| Running Update Time | 40        |
-----------------------------------
--2024-08-11 00:05:10.350882 UTC---
| Itration            | 41        |
| Real Det Return     | 769       |
| Real Sto Return     | -254      |
| Reward Loss         | -3.06e+06 |
| Running Env Steps   | 205000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 1e+03     |
| Running Update Time | 41        |
-----------------------------------
--2024-08-11 00:06:43.299613 UTC---
| Itration            | 42        |
| Real Det Return     | 800       |
| Real Sto Return     | -226      |
| Reward Loss         | -2.87e+06 |
| Running Env Steps   | 210000    |
| Running Forward KL  | 144       |
| Running Reverse KL  | 878       |
| Running Update Time | 42        |
-----------------------------------
--2024-08-11 00:08:17.588745 UTC---
| Itration            | 43        |
| Real Det Return     | 767       |
| Real Sto Return     | -224      |
| Reward Loss         | -3.05e+06 |
| Running Env Steps   | 215000    |
| Running Forward KL  | 141       |
| Running Reverse KL  | 573       |
| Running Update Time | 43        |
-----------------------------------
--2024-08-11 00:09:50.968969 UTC---
| Itration            | 44        |
| Real Det Return     | 710       |
| Real Sto Return     | -225      |
| Reward Loss         | -3.05e+06 |
| Running Env Steps   | 220000    |
| Running Forward KL  | 141       |
| Running Reverse KL  | 653       |
| Running Update Time | 44        |
-----------------------------------
--2024-08-11 00:11:26.245265 UTC---
| Itration            | 45        |
| Real Det Return     | 849       |
| Real Sto Return     | -232      |
| Reward Loss         | -3.26e+06 |
| Running Env Steps   | 225000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 547       |
| Running Update Time | 45        |
-----------------------------------
--2024-08-11 00:13:01.031615 UTC---
| Itration            | 46        |
| Real Det Return     | 801       |
| Real Sto Return     | -233      |
| Reward Loss         | -3.28e+06 |
| Running Env Steps   | 230000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 412       |
| Running Update Time | 46        |
-----------------------------------
--2024-08-11 00:14:34.957150 UTC---
| Itration            | 47        |
| Real Det Return     | 601       |
| Real Sto Return     | -232      |
| Reward Loss         | -3.44e+06 |
| Running Env Steps   | 235000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 704       |
| Running Update Time | 47        |
-----------------------------------
--2024-08-11 00:16:09.669279 UTC---
| Itration            | 48        |
| Real Det Return     | 703       |
| Real Sto Return     | -244      |
| Reward Loss         | -3.43e+06 |
| Running Env Steps   | 240000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 893       |
| Running Update Time | 48        |
-----------------------------------
--2024-08-11 00:17:43.687187 UTC---
| Itration            | 49        |
| Real Det Return     | 651       |
| Real Sto Return     | -225      |
| Reward Loss         | -3.57e+06 |
| Running Env Steps   | 245000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 1.04e+03  |
| Running Update Time | 49        |
-----------------------------------
--2024-08-11 00:19:20.364167 UTC--
| Itration            | 50       |
| Real Det Return     | 571      |
| Real Sto Return     | -272     |
| Reward Loss         | -3.6e+06 |
| Running Env Steps   | 250000   |
| Running Forward KL  | 141      |
| Running Reverse KL  | 689      |
| Running Update Time | 50       |
----------------------------------
--2024-08-11 00:20:55.846312 UTC--
| Itration            | 51       |
| Real Det Return     | 737      |
| Real Sto Return     | -239     |
| Reward Loss         | -3.9e+06 |
| Running Env Steps   | 255000   |
| Running Forward KL  | 141      |
| Running Reverse KL  | 1.01e+03 |
| Running Update Time | 51       |
----------------------------------
--2024-08-11 00:22:32.664903 UTC---
| Itration            | 52        |
| Real Det Return     | 777       |
| Real Sto Return     | -232      |
| Reward Loss         | -3.85e+06 |
| Running Env Steps   | 260000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 245       |
| Running Update Time | 52        |
-----------------------------------
--2024-08-11 00:24:08.875150 UTC---
| Itration            | 53        |
| Real Det Return     | 716       |
| Real Sto Return     | -241      |
| Reward Loss         | -3.77e+06 |
| Running Env Steps   | 265000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 963       |
| Running Update Time | 53        |
-----------------------------------
--2024-08-11 00:25:45.076045 UTC---
| Itration            | 54        |
| Real Det Return     | 642       |
| Real Sto Return     | -264      |
| Reward Loss         | -4.02e+06 |
| Running Env Steps   | 270000    |
| Running Forward KL  | 144       |
| Running Reverse KL  | 1.26e+03  |
| Running Update Time | 54        |
-----------------------------------
--2024-08-11 00:27:22.128368 UTC--
| Itration            | 55       |
| Real Det Return     | 773      |
| Real Sto Return     | -234     |
| Reward Loss         | -4.1e+06 |
| Running Env Steps   | 275000   |
| Running Forward KL  | 136      |
| Running Reverse KL  | 470      |
| Running Update Time | 55       |
----------------------------------
--2024-08-11 00:28:59.862748 UTC---
| Itration            | 56        |
| Real Det Return     | 726       |
| Real Sto Return     | -259      |
| Reward Loss         | -4.24e+06 |
| Running Env Steps   | 280000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 373       |
| Running Update Time | 56        |
-----------------------------------
--2024-08-11 00:30:37.981092 UTC---
| Itration            | 57        |
| Real Det Return     | 693       |
| Real Sto Return     | -235      |
| Reward Loss         | -4.13e+06 |
| Running Env Steps   | 285000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 236       |
| Running Update Time | 57        |
-----------------------------------
--2024-08-11 00:32:15.429761 UTC---
| Itration            | 58        |
| Real Det Return     | 669       |
| Real Sto Return     | -253      |
| Reward Loss         | -4.52e+06 |
| Running Env Steps   | 290000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 610       |
| Running Update Time | 58        |
-----------------------------------
--2024-08-11 00:33:52.365357 UTC---
| Itration            | 59        |
| Real Det Return     | 699       |
| Real Sto Return     | -238      |
| Reward Loss         | -4.59e+06 |
| Running Env Steps   | 295000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 668       |
| Running Update Time | 59        |
-----------------------------------
--2024-08-11 00:35:28.862698 UTC---
| Itration            | 60        |
| Real Det Return     | 769       |
| Real Sto Return     | -273      |
| Reward Loss         | -4.33e+06 |
| Running Env Steps   | 300000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 1.03e+03  |
| Running Update Time | 60        |
-----------------------------------
--2024-08-11 00:37:06.506872 UTC---
| Itration            | 61        |
| Real Det Return     | 789       |
| Real Sto Return     | -246      |
| Reward Loss         | -4.56e+06 |
| Running Env Steps   | 305000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 546       |
| Running Update Time | 61        |
-----------------------------------
--2024-08-11 00:38:42.731355 UTC---
| Itration            | 62        |
| Real Det Return     | 792       |
| Real Sto Return     | -206      |
| Reward Loss         | -4.61e+06 |
| Running Env Steps   | 310000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 1.23e+03  |
| Running Update Time | 62        |
-----------------------------------
--2024-08-11 00:40:22.157249 UTC---
| Itration            | 63        |
| Real Det Return     | 809       |
| Real Sto Return     | -299      |
| Reward Loss         | -4.82e+06 |
| Running Env Steps   | 315000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 398       |
| Running Update Time | 63        |
-----------------------------------
--2024-08-11 00:41:59.290351 UTC---
| Itration            | 64        |
| Real Det Return     | 759       |
| Real Sto Return     | -237      |
| Reward Loss         | -5.01e+06 |
| Running Env Steps   | 320000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 673       |
| Running Update Time | 64        |
-----------------------------------
--2024-08-11 00:43:35.178848 UTC---
| Itration            | 65        |
| Real Det Return     | 850       |
| Real Sto Return     | -178      |
| Reward Loss         | -5.42e+06 |
| Running Env Steps   | 325000    |
| Running Forward KL  | 144       |
| Running Reverse KL  | 536       |
| Running Update Time | 65        |
-----------------------------------
--2024-08-11 00:45:13.097467 UTC---
| Itration            | 66        |
| Real Det Return     | 707       |
| Real Sto Return     | -254      |
| Reward Loss         | -5.26e+06 |
| Running Env Steps   | 330000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 977       |
| Running Update Time | 66        |
-----------------------------------
--2024-08-11 00:46:50.963066 UTC---
| Itration            | 67        |
| Real Det Return     | 680       |
| Real Sto Return     | -223      |
| Reward Loss         | -5.23e+06 |
| Running Env Steps   | 335000    |
| Running Forward KL  | 141       |
| Running Reverse KL  | 361       |
| Running Update Time | 67        |
-----------------------------------
--2024-08-11 00:48:29.782693 UTC---
| Itration            | 68        |
| Real Det Return     | 698       |
| Real Sto Return     | -233      |
| Reward Loss         | -5.29e+06 |
| Running Env Steps   | 340000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 293       |
| Running Update Time | 68        |
-----------------------------------
--2024-08-11 00:50:08.334044 UTC---
| Itration            | 69        |
| Real Det Return     | 744       |
| Real Sto Return     | -230      |
| Reward Loss         | -5.23e+06 |
| Running Env Steps   | 345000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 654       |
| Running Update Time | 69        |
-----------------------------------
--2024-08-11 00:51:46.855896 UTC---
| Itration            | 70        |
| Real Det Return     | 809       |
| Real Sto Return     | -206      |
| Reward Loss         | -5.35e+06 |
| Running Env Steps   | 350000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 413       |
| Running Update Time | 70        |
-----------------------------------
--2024-08-11 00:53:26.509573 UTC---
| Itration            | 71        |
| Real Det Return     | 842       |
| Real Sto Return     | -281      |
| Reward Loss         | -5.95e+06 |
| Running Env Steps   | 355000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 567       |
| Running Update Time | 71        |
-----------------------------------
--2024-08-11 00:55:06.379814 UTC---
| Itration            | 72        |
| Real Det Return     | 714       |
| Real Sto Return     | -299      |
| Reward Loss         | -5.76e+06 |
| Running Env Steps   | 360000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 532       |
| Running Update Time | 72        |
-----------------------------------
--2024-08-11 00:56:42.166902 UTC---
| Itration            | 73        |
| Real Det Return     | 826       |
| Real Sto Return     | -187      |
| Reward Loss         | -6.15e+06 |
| Running Env Steps   | 365000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 1.24e+03  |
| Running Update Time | 73        |
-----------------------------------
--2024-08-11 00:58:21.042544 UTC---
| Itration            | 74        |
| Real Det Return     | 785       |
| Real Sto Return     | -252      |
| Reward Loss         | -5.87e+06 |
| Running Env Steps   | 370000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 488       |
| Running Update Time | 74        |
-----------------------------------
--2024-08-11 01:00:00.105534 UTC---
| Itration            | 75        |
| Real Det Return     | 770       |
| Real Sto Return     | -204      |
| Reward Loss         | -5.98e+06 |
| Running Env Steps   | 375000    |
| Running Forward KL  | 136       |
| Running Reverse KL  | 437       |
| Running Update Time | 75        |
-----------------------------------
--2024-08-11 01:01:39.270842 UTC---
| Itration            | 76        |
| Real Det Return     | 822       |
| Real Sto Return     | -207      |
| Reward Loss         | -6.03e+06 |
| Running Env Steps   | 380000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 578       |
| Running Update Time | 76        |
-----------------------------------
--2024-08-11 01:03:18.146252 UTC---
| Itration            | 77        |
| Real Det Return     | 742       |
| Real Sto Return     | -200      |
| Reward Loss         | -6.36e+06 |
| Running Env Steps   | 385000    |
| Running Forward KL  | 142       |
| Running Reverse KL  | 518       |
| Running Update Time | 77        |
-----------------------------------
--2024-08-11 01:04:57.774793 UTC---
| Itration            | 78        |
| Real Det Return     | 674       |
| Real Sto Return     | -223      |
| Reward Loss         | -6.24e+06 |
| Running Env Steps   | 390000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 275       |
| Running Update Time | 78        |
-----------------------------------
--2024-08-11 01:06:38.190981 UTC---
| Itration            | 79        |
| Real Det Return     | 643       |
| Real Sto Return     | -276      |
| Reward Loss         | -6.19e+06 |
| Running Env Steps   | 395000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 475       |
| Running Update Time | 79        |
-----------------------------------
--2024-08-11 01:08:17.679012 UTC---
| Itration            | 80        |
| Real Det Return     | 768       |
| Real Sto Return     | -228      |
| Reward Loss         | -6.62e+06 |
| Running Env Steps   | 400000    |
| Running Forward KL  | 141       |
| Running Reverse KL  | 338       |
| Running Update Time | 80        |
-----------------------------------
--2024-08-11 01:09:58.025177 UTC---
| Itration            | 81        |
| Real Det Return     | 749       |
| Real Sto Return     | -201      |
| Reward Loss         | -6.56e+06 |
| Running Env Steps   | 405000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 46.2      |
| Running Update Time | 81        |
-----------------------------------
--2024-08-11 01:11:37.767795 UTC---
| Itration            | 82        |
| Real Det Return     | 772       |
| Real Sto Return     | -223      |
| Reward Loss         | -6.68e+06 |
| Running Env Steps   | 410000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 409       |
| Running Update Time | 82        |
-----------------------------------
--2024-08-11 01:13:19.310147 UTC---
| Itration            | 83        |
| Real Det Return     | 610       |
| Real Sto Return     | -201      |
| Reward Loss         | -6.77e+06 |
| Running Env Steps   | 415000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 269       |
| Running Update Time | 83        |
-----------------------------------
--2024-08-11 01:14:59.312677 UTC---
| Itration            | 84        |
| Real Det Return     | 713       |
| Real Sto Return     | -155      |
| Reward Loss         | -6.91e+06 |
| Running Env Steps   | 420000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 293       |
| Running Update Time | 84        |
-----------------------------------
--2024-08-11 01:16:39.103296 UTC---
| Itration            | 85        |
| Real Det Return     | 796       |
| Real Sto Return     | -179      |
| Reward Loss         | -6.88e+06 |
| Running Env Steps   | 425000    |
| Running Forward KL  | 133       |
| Running Reverse KL  | 391       |
| Running Update Time | 85        |
-----------------------------------
--2024-08-11 01:18:18.674117 UTC---
| Itration            | 86        |
| Real Det Return     | 855       |
| Real Sto Return     | -198      |
| Reward Loss         | -7.64e+06 |
| Running Env Steps   | 430000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 711       |
| Running Update Time | 86        |
-----------------------------------
--2024-08-11 01:20:00.090183 UTC--
| Itration            | 87       |
| Real Det Return     | 701      |
| Real Sto Return     | -201     |
| Reward Loss         | -7.1e+06 |
| Running Env Steps   | 435000   |
| Running Forward KL  | 134      |
| Running Reverse KL  | 46.6     |
| Running Update Time | 87       |
----------------------------------
--2024-08-11 01:21:41.568651 UTC--
| Itration            | 88       |
| Real Det Return     | 800      |
| Real Sto Return     | -185     |
| Reward Loss         | -7.2e+06 |
| Running Env Steps   | 440000   |
| Running Forward KL  | 134      |
| Running Reverse KL  | 170      |
| Running Update Time | 88       |
----------------------------------
--2024-08-11 01:23:22.845103 UTC---
| Itration            | 89        |
| Real Det Return     | 474       |
| Real Sto Return     | -191      |
| Reward Loss         | -7.27e+06 |
| Running Env Steps   | 445000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 691       |
| Running Update Time | 89        |
-----------------------------------
--2024-08-11 01:25:03.704251 UTC---
| Itration            | 90        |
| Real Det Return     | 660       |
| Real Sto Return     | -196      |
| Reward Loss         | -7.65e+06 |
| Running Env Steps   | 450000    |
| Running Forward KL  | 135       |
| Running Reverse KL  | 176       |
| Running Update Time | 90        |
-----------------------------------
--2024-08-11 01:26:45.945235 UTC---
| Itration            | 91        |
| Real Det Return     | 632       |
| Real Sto Return     | -193      |
| Reward Loss         | -7.31e+06 |
| Running Env Steps   | 455000    |
| Running Forward KL  | 134       |
| Running Reverse KL  | 52.2      |
| Running Update Time | 91        |
-----------------------------------
--2024-08-11 01:28:28.213297 UTC---
| Itration            | 92        |
| Real Det Return     | 770       |
| Real Sto Return     | -223      |
| Reward Loss         | -7.95e+06 |
| Running Env Steps   | 460000    |
| Running Forward KL  | 136       |
| Running Reverse KL  | 262       |
| Running Update Time | 92        |
-----------------------------------
--2024-08-11 01:30:08.231218 UTC---
| Itration            | 93        |
| Real Det Return     | 747       |
| Real Sto Return     | -202      |
| Reward Loss         | -7.72e+06 |
| Running Env Steps   | 465000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 773       |
| Running Update Time | 93        |
-----------------------------------
--2024-08-11 01:31:50.601733 UTC---
| Itration            | 94        |
| Real Det Return     | 618       |
| Real Sto Return     | -138      |
| Reward Loss         | -7.76e+06 |
| Running Env Steps   | 470000    |
| Running Forward KL  | 135       |
| Running Reverse KL  | 49.7      |
| Running Update Time | 94        |
-----------------------------------
--2024-08-11 01:33:31.463405 UTC---
| Itration            | 95        |
| Real Det Return     | 741       |
| Real Sto Return     | -220      |
| Reward Loss         | -8.44e+06 |
| Running Env Steps   | 475000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 249       |
| Running Update Time | 95        |
-----------------------------------
--2024-08-11 01:35:12.059504 UTC---
| Itration            | 96        |
| Real Det Return     | 779       |
| Real Sto Return     | -112      |
| Reward Loss         | -8.06e+06 |
| Running Env Steps   | 480000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 649       |
| Running Update Time | 96        |
-----------------------------------
--2024-08-11 01:36:53.591106 UTC---
| Itration            | 97        |
| Real Det Return     | 830       |
| Real Sto Return     | -166      |
| Reward Loss         | -8.39e+06 |
| Running Env Steps   | 485000    |
| Running Forward KL  | 136       |
| Running Reverse KL  | 564       |
| Running Update Time | 97        |
-----------------------------------
--2024-08-11 01:38:35.398781 UTC---
| Itration            | 98        |
| Real Det Return     | 713       |
| Real Sto Return     | -190      |
| Reward Loss         | -8.46e+06 |
| Running Env Steps   | 490000    |
| Running Forward KL  | 135       |
| Running Reverse KL  | 178       |
| Running Update Time | 98        |
-----------------------------------
--2024-08-11 01:40:17.605591 UTC---
| Itration            | 99        |
| Real Det Return     | 709       |
| Real Sto Return     | -229      |
| Reward Loss         | -9.03e+06 |
| Running Env Steps   | 495000    |
| Running Forward KL  | 140       |
| Running Reverse KL  | 404       |
| Running Update Time | 99        |
-----------------------------------
--2024-08-11 01:41:58.484449 UTC---
| Itration            | 100       |
| Real Det Return     | 759       |
| Real Sto Return     | -211      |
| Reward Loss         | -8.77e+06 |
| Running Env Steps   | 500000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 649       |
| Running Update Time | 100       |
-----------------------------------
--2024-08-11 01:43:41.649179 UTC---
| Itration            | 101       |
| Real Det Return     | 770       |
| Real Sto Return     | -198      |
| Reward Loss         | -9.02e+06 |
| Running Env Steps   | 505000    |
| Running Forward KL  | 139       |
| Running Reverse KL  | 193       |
| Running Update Time | 101       |
-----------------------------------
--2024-08-11 01:45:24.268024 UTC---
| Itration            | 102       |
| Real Det Return     | 669       |
| Real Sto Return     | -191      |
| Reward Loss         | -8.86e+06 |
| Running Env Steps   | 510000    |
| Running Forward KL  | 132       |
| Running Reverse KL  | 240       |
| Running Update Time | 102       |
-----------------------------------
--2024-08-11 01:47:05.684372 UTC---
| Itration            | 103       |
| Real Det Return     | 665       |
| Real Sto Return     | -180      |
| Reward Loss         | -9.12e+06 |
| Running Env Steps   | 515000    |
| Running Forward KL  | 138       |
| Running Reverse KL  | 642       |
| Running Update Time | 103       |
-----------------------------------
--2024-08-11 01:48:47.423117 UTC---
| Itration            | 104       |
| Real Det Return     | 689       |
| Real Sto Return     | -183      |
| Reward Loss         | -9.25e+06 |
| Running Env Steps   | 520000    |
| Running Forward KL  | 136       |
| Running Reverse KL  | 552       |
| Running Update Time | 104       |
-----------------------------------
--2024-08-11 01:50:29.906792 UTC---
| Itration            | 105       |
| Real Det Return     | 699       |
| Real Sto Return     | -181      |
| Reward Loss         | -9.47e+06 |
| Running Env Steps   | 525000    |
| Running Forward KL  | 136       |
| Running Reverse KL  | 46.6      |
| Running Update Time | 105       |
-----------------------------------
--2024-08-11 01:52:12.132611 UTC---
| Itration            | 106       |
| Real Det Return     | 697       |
| Real Sto Return     | -120      |
| Reward Loss         | -9.27e+06 |
| Running Env Steps   | 530000    |
| Running Forward KL  | 136       |
| Running Reverse KL  | 305       |
| Running Update Time | 106       |
-----------------------------------
--2024-08-11 01:53:54.066921 UTC---
| Itration            | 107       |
| Real Det Return     | 758       |
| Real Sto Return     | -166      |
| Reward Loss         | -9.46e+06 |
| Running Env Steps   | 535000    |
| Running Forward KL  | 132       |
| Running Reverse KL  | 46.8      |
| Running Update Time | 107       |
-----------------------------------
--2024-08-11 01:55:34.296916 UTC---
| Itration            | 108       |
| Real Det Return     | 689       |
| Real Sto Return     | -157      |
| Reward Loss         | -9.58e+06 |
| Running Env Steps   | 540000    |
| Running Forward KL  | 134       |
| Running Reverse KL  | 844       |
| Running Update Time | 108       |
-----------------------------------
--2024-08-11 01:57:16.596672 UTC---
| Itration            | 109       |
| Real Det Return     | 760       |
| Real Sto Return     | -168      |
| Reward Loss         | -9.67e+06 |
| Running Env Steps   | 545000    |
| Running Forward KL  | 130       |
| Running Reverse KL  | 86.9      |
| Running Update Time | 109       |
-----------------------------------
--2024-08-11 01:58:59.501309 UTC--
| Itration            | 110      |
| Real Det Return     | 742      |
| Real Sto Return     | -162     |
| Reward Loss         | -9.5e+06 |
| Running Env Steps   | 550000   |
| Running Forward KL  | 130      |
| Running Reverse KL  | 48.3     |
| Running Update Time | 110      |
----------------------------------
--2024-08-11 02:00:41.945540 UTC---
| Itration            | 111       |
| Real Det Return     | 645       |
| Real Sto Return     | -191      |
| Reward Loss         | -1.03e+07 |
| Running Env Steps   | 555000    |
| Running Forward KL  | 131       |
| Running Reverse KL  | 45.8      |
| Running Update Time | 111       |
-----------------------------------
--2024-08-11 02:02:24.320008 UTC---
| Itration            | 112       |
| Real Det Return     | 630       |
| Real Sto Return     | -214      |
| Reward Loss         | -1.02e+07 |
| Running Env Steps   | 560000    |
| Running Forward KL  | 137       |
| Running Reverse KL  | 200       |
| Running Update Time | 112       |
-----------------------------------
--2024-08-11 02:04:06.820342 UTC---
| Itration            | 113       |
| Real Det Return     | 700       |
| Real Sto Return     | -95.1     |
| Reward Loss         | -1.01e+07 |
| Running Env Steps   | 565000    |
| Running Forward KL  | 132       |
| Running Reverse KL  | 360       |
| Running Update Time | 113       |
-----------------------------------
--2024-08-11 02:05:50.782317 UTC---
| Itration            | 114       |
| Real Det Return     | 579       |
| Real Sto Return     | -187      |
| Reward Loss         | -1.02e+07 |
| Running Env Steps   | 570000    |
| Running Forward KL  | 135       |
| Running Reverse KL  | 52.5      |
| Running Update Time | 114       |
-----------------------------------
--2024-08-11 02:07:34.211852 UTC---
| Itration            | 115       |
| Real Det Return     | 752       |
| Real Sto Return     | -122      |
| Reward Loss         | -1.01e+07 |
| Running Env Steps   | 575000    |
| Running Forward KL  | 127       |
| Running Reverse KL  | 67        |
| Running Update Time | 115       |
-----------------------------------
--2024-08-11 02:09:17.274291 UTC---
| Itration            | 116       |
| Real Det Return     | 478       |
| Real Sto Return     | -152      |
| Reward Loss         | -1.04e+07 |
| Running Env Steps   | 580000    |
| Running Forward KL  | 131       |
| Running Reverse KL  | 146       |
| Running Update Time | 116       |
-----------------------------------
--2024-08-11 02:11:00.532021 UTC---
| Itration            | 117       |
| Real Det Return     | 714       |
| Real Sto Return     | -108      |
| Reward Loss         | -1.06e+07 |
| Running Env Steps   | 585000    |
| Running Forward KL  | 130       |
| Running Reverse KL  | 47.3      |
| Running Update Time | 117       |
-----------------------------------
--2024-08-11 02:12:43.789148 UTC---
| Itration            | 118       |
| Real Det Return     | 606       |
| Real Sto Return     | -94       |
| Reward Loss         | -1.13e+07 |
| Running Env Steps   | 590000    |
| Running Forward KL  | 130       |
| Running Reverse KL  | 44.8      |
| Running Update Time | 118       |
-----------------------------------
--2024-08-11 02:14:26.887845 UTC---
| Itration            | 119       |
| Real Det Return     | 486       |
| Real Sto Return     | -149      |
| Reward Loss         | -1.08e+07 |
| Running Env Steps   | 595000    |
| Running Forward KL  | 130       |
| Running Reverse KL  | 50.8      |
| Running Update Time | 119       |
-----------------------------------
--2024-08-11 02:16:09.964426 UTC---
| Itration            | 120       |
| Real Det Return     | 378       |
| Real Sto Return     | -62.9     |
| Reward Loss         | -1.05e+07 |
| Running Env Steps   | 600000    |
| Running Forward KL  | 130       |
| Running Reverse KL  | 316       |
| Running Update Time | 120       |
-----------------------------------
--2024-08-11 02:17:52.815514 UTC---
| Itration            | 121       |
| Real Det Return     | 650       |
| Real Sto Return     | -130      |
| Reward Loss         | -1.11e+07 |
| Running Env Steps   | 605000    |
| Running Forward KL  | 129       |
| Running Reverse KL  | 268       |
| Running Update Time | 121       |
-----------------------------------
--2024-08-11 02:19:36.081358 UTC---
| Itration            | 122       |
| Real Det Return     | 400       |
| Real Sto Return     | -28.9     |
| Reward Loss         | -1.12e+07 |
| Running Env Steps   | 610000    |
| Running Forward KL  | 128       |
| Running Reverse KL  | 180       |
| Running Update Time | 122       |
-----------------------------------
--2024-08-11 02:21:19.206048 UTC---
| Itration            | 123       |
| Real Det Return     | 408       |
| Real Sto Return     | -100      |
| Reward Loss         | -1.12e+07 |
| Running Env Steps   | 615000    |
| Running Forward KL  | 129       |
| Running Reverse KL  | 428       |
| Running Update Time | 123       |
-----------------------------------
--2024-08-11 02:23:02.222227 UTC---
| Itration            | 124       |
| Real Det Return     | 618       |
| Real Sto Return     | -77.1     |
| Reward Loss         | -1.14e+07 |
| Running Env Steps   | 620000    |
| Running Forward KL  | 122       |
| Running Reverse KL  | 229       |
| Running Update Time | 124       |
-----------------------------------
--2024-08-11 02:24:44.739220 UTC---
| Itration            | 125       |
| Real Det Return     | 492       |
| Real Sto Return     | -44.1     |
| Reward Loss         | -1.15e+07 |
| Running Env Steps   | 625000    |
| Running Forward KL  | 126       |
| Running Reverse KL  | 49.1      |
| Running Update Time | 125       |
-----------------------------------
--2024-08-11 02:26:27.756444 UTC---
| Itration            | 126       |
| Real Det Return     | 341       |
| Real Sto Return     | -27       |
| Reward Loss         | -1.16e+07 |
| Running Env Steps   | 630000    |
| Running Forward KL  | 126       |
| Running Reverse KL  | 47.2      |
| Running Update Time | 126       |
-----------------------------------
--2024-08-11 02:28:10.188929 UTC---
| Itration            | 127       |
| Real Det Return     | 386       |
| Real Sto Return     | -91.9     |
| Reward Loss         | -1.14e+07 |
| Running Env Steps   | 635000    |
| Running Forward KL  | 120       |
| Running Reverse KL  | 104       |
| Running Update Time | 127       |
-----------------------------------
--2024-08-11 02:29:52.666701 UTC---
| Itration            | 128       |
| Real Det Return     | 591       |
| Real Sto Return     | 1.15      |
| Reward Loss         | -1.16e+07 |
| Running Env Steps   | 640000    |
| Running Forward KL  | 126       |
| Running Reverse KL  | 374       |
| Running Update Time | 128       |
-----------------------------------
--2024-08-11 02:31:36.621335 UTC---
| Itration            | 129       |
| Real Det Return     | 280       |
| Real Sto Return     | -29.7     |
| Reward Loss         | -1.18e+07 |
| Running Env Steps   | 645000    |
| Running Forward KL  | 128       |
| Running Reverse KL  | 52        |
| Running Update Time | 129       |
-----------------------------------
--2024-08-11 02:33:19.077375 UTC---
| Itration            | 130       |
| Real Det Return     | 582       |
| Real Sto Return     | 31.4      |
| Reward Loss         | -1.29e+07 |
| Running Env Steps   | 650000    |
| Running Forward KL  | 127       |
| Running Reverse KL  | 123       |
| Running Update Time | 130       |
-----------------------------------
--2024-08-11 02:35:01.934139 UTC---
| Itration            | 131       |
| Real Det Return     | 438       |
| Real Sto Return     | 12.2      |
| Reward Loss         | -1.23e+07 |
| Running Env Steps   | 655000    |
| Running Forward KL  | 127       |
| Running Reverse KL  | 407       |
| Running Update Time | 131       |
-----------------------------------
--2024-08-11 02:36:44.742788 UTC---
| Itration            | 132       |
| Real Det Return     | 558       |
| Real Sto Return     | 28.1      |
| Reward Loss         | -1.25e+07 |
| Running Env Steps   | 660000    |
| Running Forward KL  | 124       |
| Running Reverse KL  | 46.6      |
| Running Update Time | 132       |
-----------------------------------
--2024-08-11 02:38:26.771559 UTC---
| Itration            | 133       |
| Real Det Return     | 462       |
| Real Sto Return     | 12.6      |
| Reward Loss         | -1.29e+07 |
| Running Env Steps   | 665000    |
| Running Forward KL  | 120       |
| Running Reverse KL  | 43.1      |
| Running Update Time | 133       |
-----------------------------------
--2024-08-11 02:40:09.429683 UTC---
| Itration            | 134       |
| Real Det Return     | 475       |
| Real Sto Return     | 48.7      |
| Reward Loss         | -1.26e+07 |
| Running Env Steps   | 670000    |
| Running Forward KL  | 122       |
| Running Reverse KL  | 347       |
| Running Update Time | 134       |
-----------------------------------
--2024-08-11 02:41:52.106637 UTC---
| Itration            | 135       |
| Real Det Return     | 481       |
| Real Sto Return     | -20.4     |
| Reward Loss         | -1.29e+07 |
| Running Env Steps   | 675000    |
| Running Forward KL  | 123       |
| Running Reverse KL  | 220       |
| Running Update Time | 135       |
-----------------------------------
--2024-08-11 02:43:34.177010 UTC---
| Itration            | 136       |
| Real Det Return     | 468       |
| Real Sto Return     | 9.83      |
| Reward Loss         | -1.31e+07 |
| Running Env Steps   | 680000    |
| Running Forward KL  | 121       |
| Running Reverse KL  | 713       |
| Running Update Time | 136       |
-----------------------------------
--2024-08-11 02:45:17.281733 UTC---
| Itration            | 137       |
| Real Det Return     | 285       |
| Real Sto Return     | 99.2      |
| Reward Loss         | -1.25e+07 |
| Running Env Steps   | 685000    |
| Running Forward KL  | 117       |
| Running Reverse KL  | 286       |
| Running Update Time | 137       |
-----------------------------------
--2024-08-11 02:46:58.638270 UTC---
| Itration            | 138       |
| Real Det Return     | 525       |
| Real Sto Return     | 46.6      |
| Reward Loss         | -1.33e+07 |
| Running Env Steps   | 690000    |
| Running Forward KL  | 112       |
| Running Reverse KL  | 41.2      |
| Running Update Time | 138       |
-----------------------------------
--2024-08-11 02:48:40.925020 UTC---
| Itration            | 139       |
| Real Det Return     | 446       |
| Real Sto Return     | -11.4     |
| Reward Loss         | -1.42e+07 |
| Running Env Steps   | 695000    |
| Running Forward KL  | 121       |
| Running Reverse KL  | 185       |
| Running Update Time | 139       |
-----------------------------------
--2024-08-11 02:50:22.381497 UTC---
| Itration            | 140       |
| Real Det Return     | 455       |
| Real Sto Return     | 62.1      |
| Reward Loss         | -1.22e+07 |
| Running Env Steps   | 700000    |
| Running Forward KL  | 111       |
| Running Reverse KL  | 741       |
| Running Update Time | 140       |
-----------------------------------
--2024-08-11 02:52:05.787733 UTC---
| Itration            | 141       |
| Real Det Return     | 376       |
| Real Sto Return     | 151       |
| Reward Loss         | -1.33e+07 |
| Running Env Steps   | 705000    |
| Running Forward KL  | 115       |
| Running Reverse KL  | 222       |
| Running Update Time | 141       |
-----------------------------------
--2024-08-11 02:53:45.495699 UTC---
| Itration            | 142       |
| Real Det Return     | 369       |
| Real Sto Return     | -39.3     |
| Reward Loss         | -1.23e+07 |
| Running Env Steps   | 710000    |
| Running Forward KL  | 111       |
| Running Reverse KL  | 1.01e+03  |
| Running Update Time | 142       |
-----------------------------------
--2024-08-11 02:55:26.973166 UTC--
| Itration            | 143      |
| Real Det Return     | 428      |
| Real Sto Return     | 179      |
| Reward Loss         | -1.3e+07 |
| Running Env Steps   | 715000   |
| Running Forward KL  | 115      |
| Running Reverse KL  | 663      |
| Running Update Time | 143      |
----------------------------------
--2024-08-11 02:57:09.435280 UTC---
| Itration            | 144       |
| Real Det Return     | 464       |
| Real Sto Return     | 177       |
| Reward Loss         | -1.31e+07 |
| Running Env Steps   | 720000    |
| Running Forward KL  | 113       |
| Running Reverse KL  | 156       |
| Running Update Time | 144       |
-----------------------------------
--2024-08-11 02:58:52.269171 UTC---
| Itration            | 145       |
| Real Det Return     | 484       |
| Real Sto Return     | 212       |
| Reward Loss         | -1.17e+07 |
| Running Env Steps   | 725000    |
| Running Forward KL  | 112       |
| Running Reverse KL  | 45.9      |
| Running Update Time | 145       |
-----------------------------------
--2024-08-11 03:00:35.064667 UTC---
| Itration            | 146       |
| Real Det Return     | 417       |
| Real Sto Return     | 205       |
| Reward Loss         | -1.28e+07 |
| Running Env Steps   | 730000    |
| Running Forward KL  | 109       |
| Running Reverse KL  | 49.9      |
| Running Update Time | 146       |
-----------------------------------
--2024-08-11 03:02:16.973938 UTC--
| Itration            | 147      |
| Real Det Return     | 418      |
| Real Sto Return     | 182      |
| Reward Loss         | -1.3e+07 |
| Running Env Steps   | 735000   |
| Running Forward KL  | 104      |
| Running Reverse KL  | 361      |
| Running Update Time | 147      |
----------------------------------
--2024-08-11 03:03:58.268751 UTC---
| Itration            | 148       |
| Real Det Return     | 413       |
| Real Sto Return     | 174       |
| Reward Loss         | -1.39e+07 |
| Running Env Steps   | 740000    |
| Running Forward KL  | 111       |
| Running Reverse KL  | 646       |
| Running Update Time | 148       |
-----------------------------------
--2024-08-11 03:05:40.148678 UTC---
| Itration            | 149       |
| Real Det Return     | 549       |
| Real Sto Return     | 498       |
| Reward Loss         | -1.42e+07 |
| Running Env Steps   | 745000    |
| Running Forward KL  | 103       |
| Running Reverse KL  | 38.9      |
| Running Update Time | 149       |
-----------------------------------
--2024-08-11 03:07:21.892189 UTC---
| Itration            | 150       |
| Real Det Return     | 466       |
| Real Sto Return     | 221       |
| Reward Loss         | -1.47e+07 |
| Running Env Steps   | 750000    |
| Running Forward KL  | 105       |
| Running Reverse KL  | 337       |
| Running Update Time | 150       |
-----------------------------------
--2024-08-11 03:09:04.177725 UTC---
| Itration            | 151       |
| Real Det Return     | 256       |
| Real Sto Return     | 417       |
| Reward Loss         | -1.32e+07 |
| Running Env Steps   | 755000    |
| Running Forward KL  | 102       |
| Running Reverse KL  | 468       |
| Running Update Time | 151       |
-----------------------------------
--2024-08-11 03:10:45.525011 UTC--
| Itration            | 152      |
| Real Det Return     | 772      |
| Real Sto Return     | 522      |
| Reward Loss         | -1.3e+07 |
| Running Env Steps   | 760000   |
| Running Forward KL  | 100      |
| Running Reverse KL  | 563      |
| Running Update Time | 152      |
----------------------------------
--2024-08-11 03:12:27.429922 UTC---
| Itration            | 153       |
| Real Det Return     | 353       |
| Real Sto Return     | 113       |
| Reward Loss         | -1.45e+07 |
| Running Env Steps   | 765000    |
| Running Forward KL  | 102       |
| Running Reverse KL  | 264       |
| Running Update Time | 153       |
-----------------------------------
--2024-08-11 03:14:09.206934 UTC---
| Itration            | 154       |
| Real Det Return     | 195       |
| Real Sto Return     | 509       |
| Reward Loss         | -1.41e+07 |
| Running Env Steps   | 770000    |
| Running Forward KL  | 97.5      |
| Running Reverse KL  | 87.4      |
| Running Update Time | 154       |
-----------------------------------
--2024-08-11 03:15:51.617249 UTC---
| Itration            | 155       |
| Real Det Return     | 738       |
| Real Sto Return     | 254       |
| Reward Loss         | -1.54e+07 |
| Running Env Steps   | 775000    |
| Running Forward KL  | 103       |
| Running Reverse KL  | 426       |
| Running Update Time | 155       |
-----------------------------------
--2024-08-11 03:17:31.228266 UTC---
| Itration            | 156       |
| Real Det Return     | 601       |
| Real Sto Return     | 209       |
| Reward Loss         | -1.22e+07 |
| Running Env Steps   | 780000    |
| Running Forward KL  | 96.9      |
| Running Reverse KL  | 1.01e+03  |
| Running Update Time | 156       |
-----------------------------------
--2024-08-11 03:19:11.946812 UTC---
| Itration            | 157       |
| Real Det Return     | 1.05e+03  |
| Real Sto Return     | 319       |
| Reward Loss         | -1.31e+07 |
| Running Env Steps   | 785000    |
| Running Forward KL  | 90.6      |
| Running Reverse KL  | 645       |
| Running Update Time | 157       |
-----------------------------------
--2024-08-11 03:20:53.295572 UTC---
| Itration            | 158       |
| Real Det Return     | 702       |
| Real Sto Return     | 305       |
| Reward Loss         | -1.49e+07 |
| Running Env Steps   | 790000    |
| Running Forward KL  | 98.2      |
| Running Reverse KL  | 657       |
| Running Update Time | 158       |
-----------------------------------
--2024-08-11 03:22:32.881669 UTC---
| Itration            | 159       |
| Real Det Return     | 757       |
| Real Sto Return     | 411       |
| Reward Loss         | -1.39e+07 |
| Running Env Steps   | 795000    |
| Running Forward KL  | 94.4      |
| Running Reverse KL  | 753       |
| Running Update Time | 159       |
-----------------------------------
--2024-08-11 03:24:13.587802 UTC---
| Itration            | 160       |
| Real Det Return     | 1.05e+03  |
| Real Sto Return     | 553       |
| Reward Loss         | -1.34e+07 |
| Running Env Steps   | 800000    |
| Running Forward KL  | 91.6      |
| Running Reverse KL  | 344       |
| Running Update Time | 160       |
-----------------------------------
--2024-08-11 03:25:51.363996 UTC---
| Itration            | 161       |
| Real Det Return     | 1.21e+03  |
| Real Sto Return     | 573       |
| Reward Loss         | -1.41e+07 |
| Running Env Steps   | 805000    |
| Running Forward KL  | 92.1      |
| Running Reverse KL  | 625       |
| Running Update Time | 161       |
-----------------------------------
--2024-08-11 03:27:26.487275 UTC---
| Itration            | 162       |
| Real Det Return     | 629       |
| Real Sto Return     | 190       |
| Reward Loss         | -1.79e+07 |
| Running Env Steps   | 810000    |
| Running Forward KL  | 99.3      |
| Running Reverse KL  | 351       |
| Running Update Time | 162       |
-----------------------------------
--2024-08-11 03:29:03.362254 UTC---
| Itration            | 163       |
| Real Det Return     | 968       |
| Real Sto Return     | 538       |
| Reward Loss         | -1.26e+07 |
| Running Env Steps   | 815000    |
| Running Forward KL  | 90.3      |
| Running Reverse KL  | 1.31e+03  |
| Running Update Time | 163       |
-----------------------------------
--2024-08-11 03:30:40.402347 UTC---
| Itration            | 164       |
| Real Det Return     | 874       |
| Real Sto Return     | 135       |
| Reward Loss         | -1.51e+07 |
| Running Env Steps   | 820000    |
| Running Forward KL  | 99.4      |
| Running Reverse KL  | 887       |
| Running Update Time | 164       |
-----------------------------------
--2024-08-11 03:32:20.962230 UTC---
| Itration            | 165       |
| Real Det Return     | 1.9e+03   |
| Real Sto Return     | 567       |
| Reward Loss         | -1.51e+07 |
| Running Env Steps   | 825000    |
| Running Forward KL  | 95.1      |
| Running Reverse KL  | 45.8      |
| Running Update Time | 165       |
-----------------------------------
--2024-08-11 03:33:57.178882 UTC---
| Itration            | 166       |
| Real Det Return     | 666       |
| Real Sto Return     | 266       |
| Reward Loss         | -1.54e+07 |
| Running Env Steps   | 830000    |
| Running Forward KL  | 92.4      |
| Running Reverse KL  | 818       |
| Running Update Time | 166       |
-----------------------------------
--2024-08-11 03:35:39.268529 UTC---
| Itration            | 167       |
| Real Det Return     | 235       |
| Real Sto Return     | 862       |
| Reward Loss         | -1.49e+07 |
| Running Env Steps   | 835000    |
| Running Forward KL  | 93.8      |
| Running Reverse KL  | 294       |
| Running Update Time | 167       |
-----------------------------------
--2024-08-11 03:37:18.880677 UTC---
| Itration            | 168       |
| Real Det Return     | 1.26e+03  |
| Real Sto Return     | 636       |
| Reward Loss         | -1.61e+07 |
| Running Env Steps   | 840000    |
| Running Forward KL  | 92.3      |
| Running Reverse KL  | 703       |
| Running Update Time | 168       |
-----------------------------------
--2024-08-11 03:38:55.543379 UTC--
| Itration            | 169      |
| Real Det Return     | 1.03e+03 |
| Real Sto Return     | 441      |
| Reward Loss         | -1.6e+07 |
| Running Env Steps   | 845000   |
| Running Forward KL  | 90.2     |
| Running Reverse KL  | 394      |
| Running Update Time | 169      |
----------------------------------
--2024-08-11 03:40:22.726313 UTC---
| Itration            | 170       |
| Real Det Return     | 335       |
| Real Sto Return     | 175       |
| Reward Loss         | -1.33e+07 |
| Running Env Steps   | 850000    |
| Running Forward KL  | 91.4      |
| Running Reverse KL  | 1.91e+03  |
| Running Update Time | 170       |
-----------------------------------
--2024-08-11 03:42:03.577603 UTC---
| Itration            | 171       |
| Real Det Return     | 1.97e+03  |
| Real Sto Return     | 1.05e+03  |
| Reward Loss         | -1.46e+07 |
| Running Env Steps   | 855000    |
| Running Forward KL  | 85.5      |
| Running Reverse KL  | 223       |
| Running Update Time | 171       |
-----------------------------------
--2024-08-11 03:43:42.610476 UTC---
| Itration            | 172       |
| Real Det Return     | 607       |
| Real Sto Return     | 865       |
| Reward Loss         | -1.37e+07 |
| Running Env Steps   | 860000    |
| Running Forward KL  | 80.9      |
| Running Reverse KL  | 780       |
| Running Update Time | 172       |
-----------------------------------
--2024-08-11 03:45:21.394403 UTC--
| Itration            | 173      |
| Real Det Return     | 1.27e+03 |
| Real Sto Return     | 948      |
| Reward Loss         | -1.3e+07 |
| Running Env Steps   | 865000   |
| Running Forward KL  | 77.2     |
| Running Reverse KL  | 626      |
| Running Update Time | 173      |
----------------------------------
--2024-08-11 03:47:00.673161 UTC---
| Itration            | 174       |
| Real Det Return     | 1.79e+03  |
| Real Sto Return     | 948       |
| Reward Loss         | -1.55e+07 |
| Running Env Steps   | 870000    |
| Running Forward KL  | 80.5      |
| Running Reverse KL  | 599       |
| Running Update Time | 174       |
-----------------------------------
--2024-08-11 03:48:40.771509 UTC---
| Itration            | 175       |
| Real Det Return     | 1.91e+03  |
| Real Sto Return     | 971       |
| Reward Loss         | -1.27e+07 |
| Running Env Steps   | 875000    |
| Running Forward KL  | 73.4      |
| Running Reverse KL  | 443       |
| Running Update Time | 175       |
-----------------------------------
--2024-08-11 03:50:21.012788 UTC---
| Itration            | 176       |
| Real Det Return     | 1.49e+03  |
| Real Sto Return     | 1.1e+03   |
| Reward Loss         | -1.47e+07 |
| Running Env Steps   | 880000    |
| Running Forward KL  | 78.4      |
| Running Reverse KL  | 484       |
| Running Update Time | 176       |
-----------------------------------
--2024-08-11 03:51:58.653549 UTC---
| Itration            | 177       |
| Real Det Return     | 1.64e+03  |
| Real Sto Return     | 485       |
| Reward Loss         | -1.49e+07 |
| Running Env Steps   | 885000    |
| Running Forward KL  | 81.8      |
| Running Reverse KL  | 1.05e+03  |
| Running Update Time | 177       |
-----------------------------------
--2024-08-11 03:53:39.135000 UTC---
| Itration            | 178       |
| Real Det Return     | 2.42e+03  |
| Real Sto Return     | 1.07e+03  |
| Reward Loss         | -1.36e+07 |
| Running Env Steps   | 890000    |
| Running Forward KL  | 76.9      |
| Running Reverse KL  | 284       |
| Running Update Time | 178       |
-----------------------------------
--2024-08-11 03:55:16.748588 UTC--
| Itration            | 179      |
| Real Det Return     | 1.86e+03 |
| Real Sto Return     | 965      |
| Reward Loss         | -1.4e+07 |
| Running Env Steps   | 895000   |
| Running Forward KL  | 72.2     |
| Running Reverse KL  | 685      |
| Running Update Time | 179      |
----------------------------------
--2024-08-11 03:56:56.898963 UTC---
| Itration            | 180       |
| Real Det Return     | 2.27e+03  |
| Real Sto Return     | 1.09e+03  |
| Reward Loss         | -1.42e+07 |
| Running Env Steps   | 900000    |
| Running Forward KL  | 74.1      |
| Running Reverse KL  | 583       |
| Running Update Time | 180       |
-----------------------------------
--2024-08-11 03:58:33.019409 UTC--
| Itration            | 181      |
| Real Det Return     | 1.17e+03 |
| Real Sto Return     | 312      |
| Reward Loss         | -1.3e+07 |
| Running Env Steps   | 905000   |
| Running Forward KL  | 77.7     |
| Running Reverse KL  | 1.19e+03 |
| Running Update Time | 181      |
----------------------------------
--2024-08-11 04:00:11.133190 UTC---
| Itration            | 182       |
| Real Det Return     | 1.66e+03  |
| Real Sto Return     | 1.08e+03  |
| Reward Loss         | -1.47e+07 |
| Running Env Steps   | 910000    |
| Running Forward KL  | 82.5      |
| Running Reverse KL  | 1.06e+03  |
| Running Update Time | 182       |
-----------------------------------
--2024-08-11 04:01:50.359752 UTC---
| Itration            | 183       |
| Real Det Return     | 2.23e+03  |
| Real Sto Return     | 764       |
| Reward Loss         | -1.56e+07 |
| Running Env Steps   | 915000    |
| Running Forward KL  | 78.9      |
| Running Reverse KL  | 570       |
| Running Update Time | 183       |
-----------------------------------
--2024-08-11 04:03:31.066778 UTC---
| Itration            | 184       |
| Real Det Return     | 2.1e+03   |
| Real Sto Return     | 1.34e+03  |
| Reward Loss         | -1.43e+07 |
| Running Env Steps   | 920000    |
| Running Forward KL  | 65        |
| Running Reverse KL  | 36.7      |
| Running Update Time | 184       |
-----------------------------------
--2024-08-11 04:05:09.648743 UTC---
| Itration            | 185       |
| Real Det Return     | 2.15e+03  |
| Real Sto Return     | 953       |
| Reward Loss         | -1.29e+07 |
| Running Env Steps   | 925000    |
| Running Forward KL  | 67.7      |
| Running Reverse KL  | 988       |
| Running Update Time | 185       |
-----------------------------------
--2024-08-11 04:06:49.914777 UTC---
| Itration            | 186       |
| Real Det Return     | 2.06e+03  |
| Real Sto Return     | 1.12e+03  |
| Reward Loss         | -1.47e+07 |
| Running Env Steps   | 930000    |
| Running Forward KL  | 71.3      |
| Running Reverse KL  | 298       |
| Running Update Time | 186       |
-----------------------------------
--2024-08-11 04:08:29.571668 UTC---
| Itration            | 187       |
| Real Det Return     | 2.19e+03  |
| Real Sto Return     | 1.39e+03  |
| Reward Loss         | -1.12e+07 |
| Running Env Steps   | 935000    |
| Running Forward KL  | 63.4      |
| Running Reverse KL  | 249       |
| Running Update Time | 187       |
-----------------------------------
--2024-08-11 04:10:09.837429 UTC--
| Itration            | 188      |
| Real Det Return     | 2.17e+03 |
| Real Sto Return     | 1.28e+03 |
| Reward Loss         | -1.4e+07 |
| Running Env Steps   | 940000   |
| Running Forward KL  | 65.9     |
| Running Reverse KL  | 451      |
| Running Update Time | 188      |
----------------------------------
--2024-08-11 04:11:46.312493 UTC---
| Itration            | 189       |
| Real Det Return     | 1.92e+03  |
| Real Sto Return     | 1.16e+03  |
| Reward Loss         | -1.23e+07 |
| Running Env Steps   | 945000    |
| Running Forward KL  | 70.4      |
| Running Reverse KL  | 828       |
| Running Update Time | 189       |
-----------------------------------
--2024-08-11 04:13:24.485102 UTC---
| Itration            | 190       |
| Real Det Return     | 2.36e+03  |
| Real Sto Return     | 1.15e+03  |
| Reward Loss         | -1.51e+07 |
| Running Env Steps   | 950000    |
| Running Forward KL  | 77.4      |
| Running Reverse KL  | 1.56e+03  |
| Running Update Time | 190       |
-----------------------------------
--2024-08-11 04:15:03.393709 UTC---
| Itration            | 191       |
| Real Det Return     | 2.34e+03  |
| Real Sto Return     | 1.29e+03  |
| Reward Loss         | -1.16e+07 |
| Running Env Steps   | 955000    |
| Running Forward KL  | 66.9      |
| Running Reverse KL  | 263       |
| Running Update Time | 191       |
-----------------------------------
--2024-08-11 04:16:43.366358 UTC---
| Itration            | 192       |
| Real Det Return     | 2.31e+03  |
| Real Sto Return     | 1.37e+03  |
| Reward Loss         | -1.48e+07 |
| Running Env Steps   | 960000    |
| Running Forward KL  | 76.5      |
| Running Reverse KL  | 250       |
| Running Update Time | 192       |
-----------------------------------
--2024-08-11 04:18:23.099378 UTC--
| Itration            | 193      |
| Real Det Return     | 2.39e+03 |
| Real Sto Return     | 1.43e+03 |
| Reward Loss         | -1.3e+07 |
| Running Env Steps   | 965000   |
| Running Forward KL  | 72.8     |
| Running Reverse KL  | 843      |
| Running Update Time | 193      |
----------------------------------
--2024-08-11 04:20:03.668833 UTC---
| Itration            | 194       |
| Real Det Return     | 2.32e+03  |
| Real Sto Return     | 1.35e+03  |
| Reward Loss         | -1.47e+07 |
| Running Env Steps   | 970000    |
| Running Forward KL  | 66.9      |
| Running Reverse KL  | 244       |
| Running Update Time | 194       |
-----------------------------------
--2024-08-11 04:21:38.090267 UTC---
| Itration            | 195       |
| Real Det Return     | 1.19e+03  |
| Real Sto Return     | 936       |
| Reward Loss         | -1.29e+07 |
| Running Env Steps   | 975000    |
| Running Forward KL  | 72.5      |
| Running Reverse KL  | 679       |
| Running Update Time | 195       |
-----------------------------------
--2024-08-11 04:23:19.403631 UTC---
| Itration            | 196       |
| Real Det Return     | 2.62e+03  |
| Real Sto Return     | 1.99e+03  |
| Reward Loss         | -1.31e+07 |
| Running Env Steps   | 980000    |
| Running Forward KL  | 64.9      |
| Running Reverse KL  | 46.8      |
| Running Update Time | 196       |
-----------------------------------
--2024-08-11 04:24:56.908536 UTC---
| Itration            | 197       |
| Real Det Return     | 1.62e+03  |
| Real Sto Return     | 1.03e+03  |
| Reward Loss         | -1.81e+07 |
| Running Env Steps   | 985000    |
| Running Forward KL  | 70        |
| Running Reverse KL  | 35.1      |
| Running Update Time | 197       |
-----------------------------------
--2024-08-11 04:26:36.354851 UTC---
| Itration            | 198       |
| Real Det Return     | 2.65e+03  |
| Real Sto Return     | 1.66e+03  |
| Reward Loss         | -1.12e+07 |
| Running Env Steps   | 990000    |
| Running Forward KL  | 58.1      |
| Running Reverse KL  | 280       |
| Running Update Time | 198       |
-----------------------------------
--2024-08-11 04:28:18.545522 UTC---
| Itration            | 199       |
| Real Det Return     | 2.44e+03  |
| Real Sto Return     | 1.91e+03  |
| Reward Loss         | -1.31e+07 |
| Running Env Steps   | 995000    |
| Running Forward KL  | 66.5      |
| Running Reverse KL  | 47.2      |
| Running Update Time | 199       |
-----------------------------------
--2024-08-11 04:29:58.292451 UTC---
| Itration            | 200       |
| Real Det Return     | 2.56e+03  |
| Real Sto Return     | 1.68e+03  |
| Reward Loss         | -1.47e+07 |
| Running Env Steps   | 1000000   |
| Running Forward KL  | 68.9      |
| Running Reverse KL  | 975       |
| Running Update Time | 200       |
-----------------------------------
--2024-08-11 04:31:29.805858 UTC---
| Itration            | 201       |
| Real Det Return     | 1.07e+03  |
| Real Sto Return     | 734       |
| Reward Loss         | -1.47e+07 |
| Running Env Steps   | 1005000   |
| Running Forward KL  | 76.3      |
| Running Reverse KL  | 1.25e+03  |
| Running Update Time | 201       |
-----------------------------------
--2024-08-11 04:33:08.708507 UTC---
| Itration            | 202       |
| Real Det Return     | 2.7e+03   |
| Real Sto Return     | 1.47e+03  |
| Reward Loss         | -1.61e+07 |
| Running Env Steps   | 1010000   |
| Running Forward KL  | 67.9      |
| Running Reverse KL  | 867       |
| Running Update Time | 202       |
-----------------------------------
--2024-08-11 04:34:48.644902 UTC---
| Itration            | 203       |
| Real Det Return     | 2.55e+03  |
| Real Sto Return     | 1.78e+03  |
| Reward Loss         | -1.19e+07 |
| Running Env Steps   | 1015000   |
| Running Forward KL  | 59.2      |
| Running Reverse KL  | 687       |
| Running Update Time | 203       |
-----------------------------------
--2024-08-11 04:36:28.219663 UTC---
| Itration            | 204       |
| Real Det Return     | 2.55e+03  |
| Real Sto Return     | 1.39e+03  |
| Reward Loss         | -1.38e+07 |
| Running Env Steps   | 1020000   |
| Running Forward KL  | 63.9      |
| Running Reverse KL  | 791       |
| Running Update Time | 204       |
-----------------------------------
--2024-08-11 04:38:08.820493 UTC--
| Itration            | 205      |
| Real Det Return     | 2.86e+03 |
| Real Sto Return     | 1.91e+03 |
| Reward Loss         | -1.2e+07 |
| Running Env Steps   | 1025000  |
| Running Forward KL  | 57.1     |
| Running Reverse KL  | 211      |
| Running Update Time | 205      |
----------------------------------
--2024-08-11 04:39:49.900533 UTC---
| Itration            | 206       |
| Real Det Return     | 2.71e+03  |
| Real Sto Return     | 1.95e+03  |
| Reward Loss         | -1.27e+07 |
| Running Env Steps   | 1030000   |
| Running Forward KL  | 56.9      |
| Running Reverse KL  | 226       |
| Running Update Time | 206       |
-----------------------------------
--2024-08-11 04:41:31.205543 UTC---
| Itration            | 207       |
| Real Det Return     | 2.78e+03  |
| Real Sto Return     | 1.82e+03  |
| Reward Loss         | -1.31e+07 |
| Running Env Steps   | 1035000   |
| Running Forward KL  | 57        |
| Running Reverse KL  | 37.2      |
| Running Update Time | 207       |
-----------------------------------
--2024-08-11 04:43:08.525020 UTC---
| Itration            | 208       |
| Real Det Return     | 2.32e+03  |
| Real Sto Return     | 1.79e+03  |
| Reward Loss         | -1.17e+07 |
| Running Env Steps   | 1040000   |
| Running Forward KL  | 59.5      |
| Running Reverse KL  | 1.28e+03  |
| Running Update Time | 208       |
-----------------------------------
--2024-08-11 04:44:46.369346 UTC---
| Itration            | 209       |
| Real Det Return     | 2.11e+03  |
| Real Sto Return     | 1.65e+03  |
| Reward Loss         | -1.18e+07 |
| Running Env Steps   | 1045000   |
| Running Forward KL  | 60        |
| Running Reverse KL  | 724       |
| Running Update Time | 209       |
-----------------------------------
--2024-08-11 04:46:28.793464 UTC---
| Itration            | 210       |
| Real Det Return     | 2.72e+03  |
| Real Sto Return     | 2.31e+03  |
| Reward Loss         | -1.23e+07 |
| Running Env Steps   | 1050000   |
| Running Forward KL  | 58.4      |
| Running Reverse KL  | 44        |
| Running Update Time | 210       |
-----------------------------------
--2024-08-11 04:48:09.359361 UTC---
| Itration            | 211       |
| Real Det Return     | 2.35e+03  |
| Real Sto Return     | 2e+03     |
| Reward Loss         | -1.12e+07 |
| Running Env Steps   | 1055000   |
| Running Forward KL  | 55.9      |
| Running Reverse KL  | 190       |
| Running Update Time | 211       |
-----------------------------------
--2024-08-11 04:49:49.155916 UTC---
| Itration            | 212       |
| Real Det Return     | 2.46e+03  |
| Real Sto Return     | 1.95e+03  |
| Reward Loss         | -1.24e+07 |
| Running Env Steps   | 1060000   |
| Running Forward KL  | 55.8      |
| Running Reverse KL  | 395       |
| Running Update Time | 212       |
-----------------------------------
--2024-08-11 04:51:19.058717 UTC---
| Itration            | 213       |
| Real Det Return     | 1.01e+03  |
| Real Sto Return     | 750       |
| Reward Loss         | -1.62e+07 |
| Running Env Steps   | 1065000   |
| Running Forward KL  | 65.4      |
| Running Reverse KL  | 1.74e+03  |
| Running Update Time | 213       |
-----------------------------------
--2024-08-11 04:52:51.760410 UTC---
| Itration            | 214       |
| Real Det Return     | 2.09e+03  |
| Real Sto Return     | 1.22e+03  |
| Reward Loss         | -1.07e+07 |
| Running Env Steps   | 1070000   |
| Running Forward KL  | 64.5      |
| Running Reverse KL  | 1.66e+03  |
| Running Update Time | 214       |
-----------------------------------
--2024-08-11 04:54:32.476085 UTC--
| Itration            | 215      |
| Real Det Return     | 2.93e+03 |
| Real Sto Return     | 2.34e+03 |
| Reward Loss         | -1e+07   |
| Running Env Steps   | 1075000  |
| Running Forward KL  | 52.8     |
| Running Reverse KL  | 42.6     |
| Running Update Time | 215      |
----------------------------------
--2024-08-11 04:56:15.186711 UTC---
| Itration            | 216       |
| Real Det Return     | 3.06e+03  |
| Real Sto Return     | 2.72e+03  |
| Reward Loss         | -1.33e+07 |
| Running Env Steps   | 1080000   |
| Running Forward KL  | 54.1      |
| Running Reverse KL  | 188       |
| Running Update Time | 216       |
-----------------------------------
--2024-08-11 04:57:56.591004 UTC---
| Itration            | 217       |
| Real Det Return     | 2.74e+03  |
| Real Sto Return     | 2.23e+03  |
| Reward Loss         | -1.19e+07 |
| Running Env Steps   | 1085000   |
| Running Forward KL  | 54.2      |
| Running Reverse KL  | 233       |
| Running Update Time | 217       |
-----------------------------------
--2024-08-11 04:59:38.513729 UTC---
| Itration            | 218       |
| Real Det Return     | 3.06e+03  |
| Real Sto Return     | 2.72e+03  |
| Reward Loss         | -1.15e+07 |
| Running Env Steps   | 1090000   |
| Running Forward KL  | 49.8      |
| Running Reverse KL  | 37.1      |
| Running Update Time | 218       |
-----------------------------------
--2024-08-11 05:01:15.625151 UTC---
| Itration            | 219       |
| Real Det Return     | 2.28e+03  |
| Real Sto Return     | 1.6e+03   |
| Reward Loss         | -1.03e+07 |
| Running Env Steps   | 1095000   |
| Running Forward KL  | 58.6      |
| Running Reverse KL  | 1.13e+03  |
| Running Update Time | 219       |
-----------------------------------
--2024-08-11 05:02:50.912967 UTC---
| Itration            | 220       |
| Real Det Return     | 2.55e+03  |
| Real Sto Return     | 1.66e+03  |
| Reward Loss         | -8.71e+06 |
| Running Env Steps   | 1100000   |
| Running Forward KL  | 53.3      |
| Running Reverse KL  | 858       |
| Running Update Time | 220       |
-----------------------------------
--2024-08-11 05:04:31.864886 UTC---
| Itration            | 221       |
| Real Det Return     | 3.08e+03  |
| Real Sto Return     | 2.67e+03  |
| Reward Loss         | -9.68e+06 |
| Running Env Steps   | 1105000   |
| Running Forward KL  | 48.8      |
| Running Reverse KL  | 38.5      |
| Running Update Time | 221       |
-----------------------------------
--2024-08-11 05:06:14.134434 UTC---
| Itration            | 222       |
| Real Det Return     | 3.03e+03  |
| Real Sto Return     | 3.08e+03  |
| Reward Loss         | -9.03e+06 |
| Running Env Steps   | 1110000   |
| Running Forward KL  | 46.1      |
| Running Reverse KL  | 51.9      |
| Running Update Time | 222       |
-----------------------------------
--2024-08-11 05:07:56.473531 UTC---
| Itration            | 223       |
| Real Det Return     | 3.19e+03  |
| Real Sto Return     | 2.54e+03  |
| Reward Loss         | -1.05e+07 |
| Running Env Steps   | 1115000   |
| Running Forward KL  | 49.9      |
| Running Reverse KL  | 269       |
| Running Update Time | 223       |
-----------------------------------
--2024-08-11 05:09:36.761069 UTC---
| Itration            | 224       |
| Real Det Return     | 2.78e+03  |
| Real Sto Return     | 2.52e+03  |
| Reward Loss         | -8.79e+06 |
| Running Env Steps   | 1120000   |
| Running Forward KL  | 46.1      |
| Running Reverse KL  | 282       |
| Running Update Time | 224       |
-----------------------------------
--2024-08-11 05:11:17.241067 UTC---
| Itration            | 225       |
| Real Det Return     | 2.75e+03  |
| Real Sto Return     | 2.46e+03  |
| Reward Loss         | -9.34e+06 |
| Running Env Steps   | 1125000   |
| Running Forward KL  | 50.7      |
| Running Reverse KL  | 133       |
| Running Update Time | 225       |
-----------------------------------
--2024-08-11 05:12:59.373895 UTC---
| Itration            | 226       |
| Real Det Return     | 3.07e+03  |
| Real Sto Return     | 2.58e+03  |
| Reward Loss         | -1.02e+07 |
| Running Env Steps   | 1130000   |
| Running Forward KL  | 49.2      |
| Running Reverse KL  | 36        |
| Running Update Time | 226       |
-----------------------------------
--2024-08-11 05:14:41.737308 UTC---
| Itration            | 227       |
| Real Det Return     | 3.36e+03  |
| Real Sto Return     | 2.87e+03  |
| Reward Loss         | -1.17e+07 |
| Running Env Steps   | 1135000   |
| Running Forward KL  | 44.3      |
| Running Reverse KL  | 281       |
| Running Update Time | 227       |
-----------------------------------
--2024-08-11 05:16:22.323231 UTC---
| Itration            | 228       |
| Real Det Return     | 3.17e+03  |
| Real Sto Return     | 2.39e+03  |
| Reward Loss         | -8.99e+06 |
| Running Env Steps   | 1140000   |
| Running Forward KL  | 44.9      |
| Running Reverse KL  | 265       |
| Running Update Time | 228       |
-----------------------------------
--2024-08-11 05:18:03.630587 UTC---
| Itration            | 229       |
| Real Det Return     | 2.82e+03  |
| Real Sto Return     | 2.64e+03  |
| Reward Loss         | -1.54e+07 |
| Running Env Steps   | 1145000   |
| Running Forward KL  | 55.9      |
| Running Reverse KL  | 824       |
| Running Update Time | 229       |
-----------------------------------
--2024-08-11 05:19:45.860892 UTC---
| Itration            | 230       |
| Real Det Return     | 3.55e+03  |
| Real Sto Return     | 2.8e+03   |
| Reward Loss         | -9.26e+06 |
| Running Env Steps   | 1150000   |
| Running Forward KL  | 44.9      |
| Running Reverse KL  | 36        |
| Running Update Time | 230       |
-----------------------------------
--2024-08-11 05:21:29.670975 UTC---
| Itration            | 231       |
| Real Det Return     | 3.43e+03  |
| Real Sto Return     | 3.04e+03  |
| Reward Loss         | -1.09e+07 |
| Running Env Steps   | 1155000   |
| Running Forward KL  | 48        |
| Running Reverse KL  | 35.2      |
| Running Update Time | 231       |
-----------------------------------
--2024-08-11 05:23:13.478936 UTC---
| Itration            | 232       |
| Real Det Return     | 3.31e+03  |
| Real Sto Return     | 2.98e+03  |
| Reward Loss         | -1.09e+07 |
| Running Env Steps   | 1160000   |
| Running Forward KL  | 51.6      |
| Running Reverse KL  | 163       |
| Running Update Time | 232       |
-----------------------------------
--2024-08-11 05:24:57.157084 UTC---
| Itration            | 233       |
| Real Det Return     | 3.73e+03  |
| Real Sto Return     | 3.3e+03   |
| Reward Loss         | -8.41e+06 |
| Running Env Steps   | 1165000   |
| Running Forward KL  | 49.6      |
| Running Reverse KL  | 97.6      |
| Running Update Time | 233       |
-----------------------------------
--2024-08-11 05:26:40.156345 UTC---
| Itration            | 234       |
| Real Det Return     | 3.32e+03  |
| Real Sto Return     | 2.99e+03  |
| Reward Loss         | -9.11e+06 |
| Running Env Steps   | 1170000   |
| Running Forward KL  | 47.1      |
| Running Reverse KL  | 291       |
| Running Update Time | 234       |
-----------------------------------
--2024-08-11 05:28:21.812779 UTC---
| Itration            | 235       |
| Real Det Return     | 3.46e+03  |
| Real Sto Return     | 2.85e+03  |
| Reward Loss         | -8.65e+06 |
| Running Env Steps   | 1175000   |
| Running Forward KL  | 49.5      |
| Running Reverse KL  | 256       |
| Running Update Time | 235       |
-----------------------------------
--2024-08-11 05:30:03.813192 UTC---
| Itration            | 236       |
| Real Det Return     | 3.55e+03  |
| Real Sto Return     | 2.68e+03  |
| Reward Loss         | -1.23e+07 |
| Running Env Steps   | 1180000   |
| Running Forward KL  | 49.4      |
| Running Reverse KL  | 276       |
| Running Update Time | 236       |
-----------------------------------
--2024-08-11 05:31:47.286051 UTC---
| Itration            | 237       |
| Real Det Return     | 3.52e+03  |
| Real Sto Return     | 3.29e+03  |
| Reward Loss         | -8.81e+06 |
| Running Env Steps   | 1185000   |
| Running Forward KL  | 44.5      |
| Running Reverse KL  | 33.8      |
| Running Update Time | 237       |
-----------------------------------
--2024-08-11 05:33:30.335884 UTC---
| Itration            | 238       |
| Real Det Return     | 3.92e+03  |
| Real Sto Return     | 3.22e+03  |
| Reward Loss         | -1.14e+07 |
| Running Env Steps   | 1190000   |
| Running Forward KL  | 48.5      |
| Running Reverse KL  | 261       |
| Running Update Time | 238       |
-----------------------------------
--2024-08-11 05:35:13.285284 UTC---
| Itration            | 239       |
| Real Det Return     | 3.75e+03  |
| Real Sto Return     | 3.32e+03  |
| Reward Loss         | -8.19e+06 |
| Running Env Steps   | 1195000   |
| Running Forward KL  | 43.7      |
| Running Reverse KL  | 102       |
| Running Update Time | 239       |
-----------------------------------
--2024-08-11 05:36:56.109237 UTC--
| Itration            | 240      |
| Real Det Return     | 3.68e+03 |
| Real Sto Return     | 2.97e+03 |
| Reward Loss         | -8.3e+06 |
| Running Env Steps   | 1200000  |
| Running Forward KL  | 48.1     |
| Running Reverse KL  | 137      |
| Running Update Time | 240      |
----------------------------------
--2024-08-11 05:38:39.782049 UTC---
| Itration            | 241       |
| Real Det Return     | 4.12e+03  |
| Real Sto Return     | 3.4e+03   |
| Reward Loss         | -7.03e+06 |
| Running Env Steps   | 1205000   |
| Running Forward KL  | 42.6      |
| Running Reverse KL  | 36.4      |
| Running Update Time | 241       |
-----------------------------------
--2024-08-11 05:40:22.115383 UTC---
| Itration            | 242       |
| Real Det Return     | 3.14e+03  |
| Real Sto Return     | 3.32e+03  |
| Reward Loss         | -8.84e+06 |
| Running Env Steps   | 1210000   |
| Running Forward KL  | 45.3      |
| Running Reverse KL  | 355       |
| Running Update Time | 242       |
-----------------------------------
--2024-08-11 05:42:05.751922 UTC---
| Itration            | 243       |
| Real Det Return     | 4.08e+03  |
| Real Sto Return     | 3.65e+03  |
| Reward Loss         | -8.38e+06 |
| Running Env Steps   | 1215000   |
| Running Forward KL  | 40        |
| Running Reverse KL  | 28.3      |
| Running Update Time | 243       |
-----------------------------------
--2024-08-11 05:43:49.135282 UTC---
| Itration            | 244       |
| Real Det Return     | 4.15e+03  |
| Real Sto Return     | 3.65e+03  |
| Reward Loss         | -6.61e+06 |
| Running Env Steps   | 1220000   |
| Running Forward KL  | 40.4      |
| Running Reverse KL  | 40.4      |
| Running Update Time | 244       |
-----------------------------------
--2024-08-11 05:45:33.106258 UTC---
| Itration            | 245       |
| Real Det Return     | 3.78e+03  |
| Real Sto Return     | 3.45e+03  |
| Reward Loss         | -8.27e+06 |
| Running Env Steps   | 1225000   |
| Running Forward KL  | 44.1      |
| Running Reverse KL  | 46.5      |
| Running Update Time | 245       |
-----------------------------------
--2024-08-11 05:47:13.153431 UTC---
| Itration            | 246       |
| Real Det Return     | 3.68e+03  |
| Real Sto Return     | 2.7e+03   |
| Reward Loss         | -8.53e+06 |
| Running Env Steps   | 1230000   |
| Running Forward KL  | 40.9      |
| Running Reverse KL  | 392       |
| Running Update Time | 246       |
-----------------------------------
--2024-08-11 05:48:56.457187 UTC---
| Itration            | 247       |
| Real Det Return     | 3.97e+03  |
| Real Sto Return     | 3.61e+03  |
| Reward Loss         | -8.19e+06 |
| Running Env Steps   | 1235000   |
| Running Forward KL  | 47.4      |
| Running Reverse KL  | 208       |
| Running Update Time | 247       |
-----------------------------------
--2024-08-11 05:50:41.567898 UTC--
| Itration            | 248      |
| Real Det Return     | 3.87e+03 |
| Real Sto Return     | 3.52e+03 |
| Reward Loss         | -8.4e+06 |
| Running Env Steps   | 1240000  |
| Running Forward KL  | 41.6     |
| Running Reverse KL  | 124      |
| Running Update Time | 248      |
----------------------------------
--2024-08-11 05:52:28.444426 UTC---
| Itration            | 249       |
| Real Det Return     | 4.21e+03  |
| Real Sto Return     | 3.8e+03   |
| Reward Loss         | -7.53e+06 |
| Running Env Steps   | 1245000   |
| Running Forward KL  | 40.6      |
| Running Reverse KL  | 38.7      |
| Running Update Time | 249       |
-----------------------------------
--2024-08-11 05:54:20.088421 UTC---
| Itration            | 250       |
| Real Det Return     | 3.73e+03  |
| Real Sto Return     | 3.37e+03  |
| Reward Loss         | -9.22e+06 |
| Running Env Steps   | 1250000   |
| Running Forward KL  | 46        |
| Running Reverse KL  | 195       |
| Running Update Time | 250       |
-----------------------------------
--2024-08-11 05:56:05.972218 UTC---
| Itration            | 251       |
| Real Det Return     | 3.4e+03   |
| Real Sto Return     | 2.95e+03  |
| Reward Loss         | -1.14e+07 |
| Running Env Steps   | 1255000   |
| Running Forward KL  | 48.9      |
| Running Reverse KL  | 644       |
| Running Update Time | 251       |
-----------------------------------
--2024-08-11 05:57:52.692368 UTC---
| Itration            | 252       |
| Real Det Return     | 3.21e+03  |
| Real Sto Return     | 3.19e+03  |
| Reward Loss         | -9.35e+06 |
| Running Env Steps   | 1260000   |
| Running Forward KL  | 46.2      |
| Running Reverse KL  | 292       |
| Running Update Time | 252       |
-----------------------------------
--2024-08-11 05:59:39.111534 UTC---
| Itration            | 253       |
| Real Det Return     | 3.81e+03  |
| Real Sto Return     | 3.28e+03  |
| Reward Loss         | -7.98e+06 |
| Running Env Steps   | 1265000   |
| Running Forward KL  | 44.5      |
| Running Reverse KL  | 124       |
| Running Update Time | 253       |
-----------------------------------
--2024-08-11 06:01:23.897023 UTC---
| Itration            | 254       |
| Real Det Return     | 3.63e+03  |
| Real Sto Return     | 3.02e+03  |
| Reward Loss         | -9.24e+06 |
| Running Env Steps   | 1270000   |
| Running Forward KL  | 43.6      |
| Running Reverse KL  | 141       |
| Running Update Time | 254       |
-----------------------------------
--2024-08-11 06:03:09.257848 UTC---
| Itration            | 255       |
| Real Det Return     | 4.17e+03  |
| Real Sto Return     | 3.46e+03  |
| Reward Loss         | -7.68e+06 |
| Running Env Steps   | 1275000   |
| Running Forward KL  | 42.3      |
| Running Reverse KL  | 253       |
| Running Update Time | 255       |
-----------------------------------
--2024-08-11 06:04:56.378033 UTC---
| Itration            | 256       |
| Real Det Return     | 4.11e+03  |
| Real Sto Return     | 3.78e+03  |
| Reward Loss         | -7.78e+06 |
| Running Env Steps   | 1280000   |
| Running Forward KL  | 44.3      |
| Running Reverse KL  | 261       |
| Running Update Time | 256       |
-----------------------------------
--2024-08-11 06:06:44.535957 UTC--
| Itration            | 257      |
| Real Det Return     | 4.05e+03 |
| Real Sto Return     | 3.74e+03 |
| Reward Loss         | -7.4e+06 |
| Running Env Steps   | 1285000  |
| Running Forward KL  | 45.4     |
| Running Reverse KL  | 170      |
| Running Update Time | 257      |
----------------------------------
--2024-08-11 06:08:31.223088 UTC---
| Itration            | 258       |
| Real Det Return     | 4.04e+03  |
| Real Sto Return     | 3.82e+03  |
| Reward Loss         | -5.63e+06 |
| Running Env Steps   | 1290000   |
| Running Forward KL  | 42        |
| Running Reverse KL  | 42.1      |
| Running Update Time | 258       |
-----------------------------------
--2024-08-11 06:10:18.109404 UTC---
| Itration            | 259       |
| Real Det Return     | 4.24e+03  |
| Real Sto Return     | 3.46e+03  |
| Reward Loss         | -7.05e+06 |
| Running Env Steps   | 1295000   |
| Running Forward KL  | 42        |
| Running Reverse KL  | 198       |
| Running Update Time | 259       |
-----------------------------------
--2024-08-11 06:12:05.480072 UTC---
| Itration            | 260       |
| Real Det Return     | 3.71e+03  |
| Real Sto Return     | 3.68e+03  |
| Reward Loss         | -8.17e+06 |
| Running Env Steps   | 1300000   |
| Running Forward KL  | 46.4      |
| Running Reverse KL  | 56.9      |
| Running Update Time | 260       |
-----------------------------------
--2024-08-11 06:13:52.650539 UTC---
| Itration            | 261       |
| Real Det Return     | 4.25e+03  |
| Real Sto Return     | 3.59e+03  |
| Reward Loss         | -7.01e+06 |
| Running Env Steps   | 1305000   |
| Running Forward KL  | 37.8      |
| Running Reverse KL  | 65.6      |
| Running Update Time | 261       |
-----------------------------------
--2024-08-11 06:15:38.920607 UTC---
| Itration            | 262       |
| Real Det Return     | 3.7e+03   |
| Real Sto Return     | 3.57e+03  |
| Reward Loss         | -7.35e+06 |
| Running Env Steps   | 1310000   |
| Running Forward KL  | 44.2      |
| Running Reverse KL  | 291       |
| Running Update Time | 262       |
-----------------------------------
--2024-08-11 06:17:24.316118 UTC---
| Itration            | 263       |
| Real Det Return     | 3.75e+03  |
| Real Sto Return     | 3.6e+03   |
| Reward Loss         | -7.73e+06 |
| Running Env Steps   | 1315000   |
| Running Forward KL  | 44.6      |
| Running Reverse KL  | 284       |
| Running Update Time | 263       |
-----------------------------------
--2024-08-11 06:19:05.896619 UTC---
| Itration            | 264       |
| Real Det Return     | 2.94e+03  |
| Real Sto Return     | 1.88e+03  |
| Reward Loss         | -1.09e+07 |
| Running Env Steps   | 1320000   |
| Running Forward KL  | 51.2      |
| Running Reverse KL  | 581       |
| Running Update Time | 264       |
-----------------------------------
--2024-08-11 06:20:52.450460 UTC---
| Itration            | 265       |
| Real Det Return     | 3.69e+03  |
| Real Sto Return     | 3.82e+03  |
| Reward Loss         | -7.61e+06 |
| Running Env Steps   | 1325000   |
| Running Forward KL  | 43.1      |
| Running Reverse KL  | 353       |
| Running Update Time | 265       |
-----------------------------------
--2024-08-11 06:22:40.069328 UTC---
| Itration            | 266       |
| Real Det Return     | 4.22e+03  |
| Real Sto Return     | 3.96e+03  |
| Reward Loss         | -5.61e+06 |
| Running Env Steps   | 1330000   |
| Running Forward KL  | 37.5      |
| Running Reverse KL  | 38.3      |
| Running Update Time | 266       |
-----------------------------------
--2024-08-11 06:24:27.784464 UTC---
| Itration            | 267       |
| Real Det Return     | 4.25e+03  |
| Real Sto Return     | 4.04e+03  |
| Reward Loss         | -6.96e+06 |
| Running Env Steps   | 1335000   |
| Running Forward KL  | 40.2      |
| Running Reverse KL  | 295       |
| Running Update Time | 267       |
-----------------------------------
--2024-08-11 06:26:15.858593 UTC---
| Itration            | 268       |
| Real Det Return     | 4.1e+03   |
| Real Sto Return     | 3.66e+03  |
| Reward Loss         | -7.68e+06 |
| Running Env Steps   | 1340000   |
| Running Forward KL  | 46.5      |
| Running Reverse KL  | 51.4      |
| Running Update Time | 268       |
-----------------------------------
--2024-08-11 06:28:04.165886 UTC---
| Itration            | 269       |
| Real Det Return     | 3.78e+03  |
| Real Sto Return     | 3.87e+03  |
| Reward Loss         | -6.98e+06 |
| Running Env Steps   | 1345000   |
| Running Forward KL  | 44.9      |
| Running Reverse KL  | 75.6      |
| Running Update Time | 269       |
-----------------------------------
--2024-08-11 06:29:51.352777 UTC---
| Itration            | 270       |
| Real Det Return     | 4.14e+03  |
| Real Sto Return     | 3.26e+03  |
| Reward Loss         | -6.28e+06 |
| Running Env Steps   | 1350000   |
| Running Forward KL  | 40.7      |
| Running Reverse KL  | 72.1      |
| Running Update Time | 270       |
-----------------------------------
--2024-08-11 06:31:37.402438 UTC---
| Itration            | 271       |
| Real Det Return     | 3.36e+03  |
| Real Sto Return     | 3.29e+03  |
| Reward Loss         | -9.61e+06 |
| Running Env Steps   | 1355000   |
| Running Forward KL  | 50.8      |
| Running Reverse KL  | 775       |
| Running Update Time | 271       |
-----------------------------------
--2024-08-11 06:33:22.311338 UTC--
| Itration            | 272      |
| Real Det Return     | 3.53e+03 |
| Real Sto Return     | 3.25e+03 |
| Reward Loss         | -1e+07   |
| Running Env Steps   | 1360000  |
| Running Forward KL  | 46.1     |
| Running Reverse KL  | 318      |
| Running Update Time | 272      |
----------------------------------
--2024-08-11 06:35:03.964477 UTC---
| Itration            | 273       |
| Real Det Return     | 2.83e+03  |
| Real Sto Return     | 2.53e+03  |
| Reward Loss         | -1.15e+07 |
| Running Env Steps   | 1365000   |
| Running Forward KL  | 59.3      |
| Running Reverse KL  | 1.57e+03  |
| Running Update Time | 273       |
-----------------------------------
--2024-08-11 06:36:52.089481 UTC---
| Itration            | 274       |
| Real Det Return     | 3.84e+03  |
| Real Sto Return     | 3.76e+03  |
| Reward Loss         | -7.72e+06 |
| Running Env Steps   | 1370000   |
| Running Forward KL  | 48        |
| Running Reverse KL  | 52        |
| Running Update Time | 274       |
-----------------------------------
--2024-08-11 06:38:41.548031 UTC---
| Itration            | 275       |
| Real Det Return     | 4e+03     |
| Real Sto Return     | 3.73e+03  |
| Reward Loss         | -6.88e+06 |
| Running Env Steps   | 1375000   |
| Running Forward KL  | 45.2      |
| Running Reverse KL  | 84.9      |
| Running Update Time | 275       |
-----------------------------------
--2024-08-11 06:40:30.061592 UTC--
| Itration            | 276      |
| Real Det Return     | 3.82e+03 |
| Real Sto Return     | 3.68e+03 |
| Reward Loss         | -6.5e+06 |
| Running Env Steps   | 1380000  |
| Running Forward KL  | 43.9     |
| Running Reverse KL  | 81.2     |
| Running Update Time | 276      |
----------------------------------
--2024-08-11 06:42:16.719904 UTC---
| Itration            | 277       |
| Real Det Return     | 3.57e+03  |
| Real Sto Return     | 3.25e+03  |
| Reward Loss         | -7.32e+06 |
| Running Env Steps   | 1385000   |
| Running Forward KL  | 41.7      |
| Running Reverse KL  | 267       |
| Running Update Time | 277       |
-----------------------------------
--2024-08-11 06:44:05.011488 UTC--
| Itration            | 278      |
| Real Det Return     | 4.22e+03 |
| Real Sto Return     | 3.79e+03 |
| Reward Loss         | -6.9e+06 |
| Running Env Steps   | 1390000  |
| Running Forward KL  | 43.4     |
| Running Reverse KL  | 155      |
| Running Update Time | 278      |
----------------------------------
--2024-08-11 06:45:53.183144 UTC---
| Itration            | 279       |
| Real Det Return     | 3.85e+03  |
| Real Sto Return     | 3.94e+03  |
| Reward Loss         | -6.99e+06 |
| Running Env Steps   | 1395000   |
| Running Forward KL  | 46.2      |
| Running Reverse KL  | 54.3      |
| Running Update Time | 279       |
-----------------------------------
--2024-08-11 06:47:42.163666 UTC---
| Itration            | 280       |
| Real Det Return     | 3.99e+03  |
| Real Sto Return     | 3.74e+03  |
| Reward Loss         | -8.45e+06 |
| Running Env Steps   | 1400000   |
| Running Forward KL  | 42.8      |
| Running Reverse KL  | 242       |
| Running Update Time | 280       |
-----------------------------------
--2024-08-11 06:49:29.682770 UTC---
| Itration            | 281       |
| Real Det Return     | 4.32e+03  |
| Real Sto Return     | 3.66e+03  |
| Reward Loss         | -7.03e+06 |
| Running Env Steps   | 1405000   |
| Running Forward KL  | 44.8      |
| Running Reverse KL  | 226       |
| Running Update Time | 281       |
-----------------------------------
--2024-08-11 06:51:17.840607 UTC---
| Itration            | 282       |
| Real Det Return     | 4.25e+03  |
| Real Sto Return     | 4.03e+03  |
| Reward Loss         | -9.13e+06 |
| Running Env Steps   | 1410000   |
| Running Forward KL  | 40.1      |
| Running Reverse KL  | 404       |
| Running Update Time | 282       |
-----------------------------------
--2024-08-11 06:53:07.559704 UTC---
| Itration            | 283       |
| Real Det Return     | 4.34e+03  |
| Real Sto Return     | 4.19e+03  |
| Reward Loss         | -5.43e+06 |
| Running Env Steps   | 1415000   |
| Running Forward KL  | 39        |
| Running Reverse KL  | 42.5      |
| Running Update Time | 283       |
-----------------------------------
--2024-08-11 06:54:56.585659 UTC---
| Itration            | 284       |
| Real Det Return     | 4.2e+03   |
| Real Sto Return     | 4.13e+03  |
| Reward Loss         | -8.95e+06 |
| Running Env Steps   | 1420000   |
| Running Forward KL  | 49        |
| Running Reverse KL  | 295       |
| Running Update Time | 284       |
-----------------------------------
--2024-08-11 06:56:43.471083 UTC---
| Itration            | 285       |
| Real Det Return     | 3.9e+03   |
| Real Sto Return     | 3.69e+03  |
| Reward Loss         | -7.73e+06 |
| Running Env Steps   | 1425000   |
| Running Forward KL  | 44.2      |
| Running Reverse KL  | 508       |
| Running Update Time | 285       |
-----------------------------------
--2024-08-11 06:58:30.167237 UTC---
| Itration            | 286       |
| Real Det Return     | 3.66e+03  |
| Real Sto Return     | 3.61e+03  |
| Reward Loss         | -8.47e+06 |
| Running Env Steps   | 1430000   |
| Running Forward KL  | 42.3      |
| Running Reverse KL  | 498       |
| Running Update Time | 286       |
-----------------------------------
--2024-08-11 07:00:19.185440 UTC---
| Itration            | 287       |
| Real Det Return     | 4.24e+03  |
| Real Sto Return     | 4.18e+03  |
| Reward Loss         | -7.16e+06 |
| Running Env Steps   | 1435000   |
| Running Forward KL  | 39.8      |
| Running Reverse KL  | 47        |
| Running Update Time | 287       |
-----------------------------------
--2024-08-11 07:02:06.338220 UTC---
| Itration            | 288       |
| Real Det Return     | 4.1e+03   |
| Real Sto Return     | 3.47e+03  |
| Reward Loss         | -6.86e+06 |
| Running Env Steps   | 1440000   |
| Running Forward KL  | 41        |
| Running Reverse KL  | 48.5      |
| Running Update Time | 288       |
-----------------------------------
--2024-08-11 07:03:54.751487 UTC---
| Itration            | 289       |
| Real Det Return     | 4.35e+03  |
| Real Sto Return     | 4.02e+03  |
| Reward Loss         | -5.92e+06 |
| Running Env Steps   | 1445000   |
| Running Forward KL  | 43.1      |
| Running Reverse KL  | 42.3      |
| Running Update Time | 289       |
-----------------------------------
--2024-08-11 07:05:42.493403 UTC---
| Itration            | 290       |
| Real Det Return     | 4.31e+03  |
| Real Sto Return     | 3.86e+03  |
| Reward Loss         | -6.09e+06 |
| Running Env Steps   | 1450000   |
| Running Forward KL  | 39.2      |
| Running Reverse KL  | 43.8      |
| Running Update Time | 290       |
-----------------------------------
--2024-08-11 07:07:31.298413 UTC---
| Itration            | 291       |
| Real Det Return     | 4.39e+03  |
| Real Sto Return     | 4.07e+03  |
| Reward Loss         | -8.31e+06 |
| Running Env Steps   | 1455000   |
| Running Forward KL  | 42.9      |
| Running Reverse KL  | 200       |
| Running Update Time | 291       |
-----------------------------------
--2024-08-11 07:09:17.628689 UTC---
| Itration            | 292       |
| Real Det Return     | 3.72e+03  |
| Real Sto Return     | 3.43e+03  |
| Reward Loss         | -6.58e+06 |
| Running Env Steps   | 1460000   |
| Running Forward KL  | 41.2      |
| Running Reverse KL  | 42.7      |
| Running Update Time | 292       |
-----------------------------------
--2024-08-11 07:11:05.703379 UTC---
| Itration            | 293       |
| Real Det Return     | 4.43e+03  |
| Real Sto Return     | 3.67e+03  |
| Reward Loss         | -6.64e+06 |
| Running Env Steps   | 1465000   |
| Running Forward KL  | 41.8      |
| Running Reverse KL  | 42        |
| Running Update Time | 293       |
-----------------------------------
--2024-08-11 07:12:51.913198 UTC---
| Itration            | 294       |
| Real Det Return     | 4.31e+03  |
| Real Sto Return     | 4.05e+03  |
| Reward Loss         | -8.93e+06 |
| Running Env Steps   | 1470000   |
| Running Forward KL  | 44        |
| Running Reverse KL  | 407       |
| Running Update Time | 294       |
-----------------------------------
--2024-08-11 07:14:40.439185 UTC---
| Itration            | 295       |
| Real Det Return     | 4.15e+03  |
| Real Sto Return     | 4.17e+03  |
| Reward Loss         | -6.57e+06 |
| Running Env Steps   | 1475000   |
| Running Forward KL  | 41.1      |
| Running Reverse KL  | 51.2      |
| Running Update Time | 295       |
-----------------------------------
--2024-08-11 07:16:27.884478 UTC---
| Itration            | 296       |
| Real Det Return     | 4.31e+03  |
| Real Sto Return     | 4.13e+03  |
| Reward Loss         | -6.09e+06 |
| Running Env Steps   | 1480000   |
| Running Forward KL  | 39.4      |
| Running Reverse KL  | 38.1      |
| Running Update Time | 296       |
-----------------------------------
--2024-08-11 07:18:16.574337 UTC---
| Itration            | 297       |
| Real Det Return     | 4.64e+03  |
| Real Sto Return     | 4.32e+03  |
| Reward Loss         | -6.74e+06 |
| Running Env Steps   | 1485000   |
| Running Forward KL  | 36.4      |
| Running Reverse KL  | 37.2      |
| Running Update Time | 297       |
-----------------------------------
--2024-08-11 07:20:04.458119 UTC---
| Itration            | 298       |
| Real Det Return     | 4.33e+03  |
| Real Sto Return     | 4.34e+03  |
| Reward Loss         | -5.65e+06 |
| Running Env Steps   | 1490000   |
| Running Forward KL  | 38.3      |
| Running Reverse KL  | 316       |
| Running Update Time | 298       |
-----------------------------------
--2024-08-11 07:21:53.216252 UTC---
| Itration            | 299       |
| Real Det Return     | 4.5e+03   |
| Real Sto Return     | 4.43e+03  |
| Reward Loss         | -5.59e+06 |
| Running Env Steps   | 1495000   |
| Running Forward KL  | 38        |
| Running Reverse KL  | 42.5      |
| Running Update Time | 299       |
-----------------------------------
--2024-08-11 07:23:39.995060 UTC---
| Itration            | 300       |
| Real Det Return     | 3.78e+03  |
| Real Sto Return     | 3.99e+03  |
| Reward Loss         | -1.06e+07 |
| Running Env Steps   | 1500000   |
| Running Forward KL  | 43.1      |
| Running Reverse KL  | 756       |
| Running Update Time | 300       |
-----------------------------------
--2024-08-11 07:25:28.571368 UTC---
| Itration            | 301       |
| Real Det Return     | 4.27e+03  |
| Real Sto Return     | 4.18e+03  |
| Reward Loss         | -7.87e+06 |
| Running Env Steps   | 1505000   |
| Running Forward KL  | 43.5      |
| Running Reverse KL  | 317       |
| Running Update Time | 301       |
-----------------------------------
--2024-08-11 07:27:17.217989 UTC---
| Itration            | 302       |
| Real Det Return     | 4.5e+03   |
| Real Sto Return     | 4.32e+03  |
| Reward Loss         | -6.41e+06 |
| Running Env Steps   | 1510000   |
| Running Forward KL  | 41.3      |
| Running Reverse KL  | 47        |
| Running Update Time | 302       |
-----------------------------------
--2024-08-11 07:29:04.729861 UTC---
| Itration            | 303       |
| Real Det Return     | 3.86e+03  |
| Real Sto Return     | 3.85e+03  |
| Reward Loss         | -5.93e+06 |
| Running Env Steps   | 1515000   |
| Running Forward KL  | 40        |
| Running Reverse KL  | 119       |
| Running Update Time | 303       |
-----------------------------------
--2024-08-11 07:30:52.826145 UTC---
| Itration            | 304       |
| Real Det Return     | 4.2e+03   |
| Real Sto Return     | 4.04e+03  |
| Reward Loss         | -7.92e+06 |
| Running Env Steps   | 1520000   |
| Running Forward KL  | 40.5      |
| Running Reverse KL  | 127       |
| Running Update Time | 304       |
-----------------------------------
--2024-08-11 07:32:42.025831 UTC---
| Itration            | 305       |
| Real Det Return     | 4.34e+03  |
| Real Sto Return     | 4.29e+03  |
| Reward Loss         | -6.51e+06 |
| Running Env Steps   | 1525000   |
| Running Forward KL  | 37.7      |
| Running Reverse KL  | 39.3      |
| Running Update Time | 305       |
-----------------------------------
--2024-08-11 07:34:31.489909 UTC---
| Itration            | 306       |
| Real Det Return     | 4.51e+03  |
| Real Sto Return     | 4.15e+03  |
| Reward Loss         | -8.99e+06 |
| Running Env Steps   | 1530000   |
| Running Forward KL  | 39.6      |
| Running Reverse KL  | 36.9      |
| Running Update Time | 306       |
-----------------------------------
--2024-08-11 07:36:19.722688 UTC---
| Itration            | 307       |
| Real Det Return     | 4.47e+03  |
| Real Sto Return     | 3.95e+03  |
| Reward Loss         | -7.65e+06 |
| Running Env Steps   | 1535000   |
| Running Forward KL  | 42        |
| Running Reverse KL  | 420       |
| Running Update Time | 307       |
-----------------------------------
--2024-08-11 07:38:06.477886 UTC---
| Itration            | 308       |
| Real Det Return     | 4.16e+03  |
| Real Sto Return     | 4.32e+03  |
| Reward Loss         | -6.76e+06 |
| Running Env Steps   | 1540000   |
| Running Forward KL  | 37.8      |
| Running Reverse KL  | 37.5      |
| Running Update Time | 308       |
-----------------------------------
--2024-08-11 07:39:51.683663 UTC---
| Itration            | 309       |
| Real Det Return     | 3.84e+03  |
| Real Sto Return     | 3.88e+03  |
| Reward Loss         | -7.39e+06 |
| Running Env Steps   | 1545000   |
| Running Forward KL  | 41.4      |
| Running Reverse KL  | 399       |
| Running Update Time | 309       |
-----------------------------------
--2024-08-11 07:41:38.378871 UTC---
| Itration            | 310       |
| Real Det Return     | 4.52e+03  |
| Real Sto Return     | 4.3e+03   |
| Reward Loss         | -6.54e+06 |
| Running Env Steps   | 1550000   |
| Running Forward KL  | 37.1      |
| Running Reverse KL  | 42.2      |
| Running Update Time | 310       |
-----------------------------------
--2024-08-11 07:43:25.760079 UTC---
| Itration            | 311       |
| Real Det Return     | 4.6e+03   |
| Real Sto Return     | 4.1e+03   |
| Reward Loss         | -7.64e+06 |
| Running Env Steps   | 1555000   |
| Running Forward KL  | 40.7      |
| Running Reverse KL  | 39.9      |
| Running Update Time | 311       |
-----------------------------------
--2024-08-11 07:45:11.218030 UTC---
| Itration            | 312       |
| Real Det Return     | 4.44e+03  |
| Real Sto Return     | 3.99e+03  |
| Reward Loss         | -5.73e+06 |
| Running Env Steps   | 1560000   |
| Running Forward KL  | 40.5      |
| Running Reverse KL  | 56.9      |
| Running Update Time | 312       |
-----------------------------------
--2024-08-11 07:46:58.471660 UTC---
| Itration            | 313       |
| Real Det Return     | 4.49e+03  |
| Real Sto Return     | 4.29e+03  |
| Reward Loss         | -6.95e+06 |
| Running Env Steps   | 1565000   |
| Running Forward KL  | 40.9      |
| Running Reverse KL  | 194       |
| Running Update Time | 313       |
-----------------------------------
--2024-08-11 07:48:44.153387 UTC---
| Itration            | 314       |
| Real Det Return     | 4.11e+03  |
| Real Sto Return     | 3.91e+03  |
| Reward Loss         | -6.66e+06 |
| Running Env Steps   | 1570000   |
| Running Forward KL  | 38.3      |
| Running Reverse KL  | 290       |
| Running Update Time | 314       |
-----------------------------------
--2024-08-11 07:50:31.565898 UTC---
| Itration            | 315       |
| Real Det Return     | 4.63e+03  |
| Real Sto Return     | 4.4e+03   |
| Reward Loss         | -6.06e+06 |
| Running Env Steps   | 1575000   |
| Running Forward KL  | 39.6      |
| Running Reverse KL  | 41.4      |
| Running Update Time | 315       |
-----------------------------------
--2024-08-11 07:52:16.913011 UTC---
| Itration            | 316       |
| Real Det Return     | 4.03e+03  |
| Real Sto Return     | 3.94e+03  |
| Reward Loss         | -6.51e+06 |
| Running Env Steps   | 1580000   |
| Running Forward KL  | 38.2      |
| Running Reverse KL  | 42.5      |
| Running Update Time | 316       |
-----------------------------------
--2024-08-11 07:54:02.923266 UTC---
| Itration            | 317       |
| Real Det Return     | 4.45e+03  |
| Real Sto Return     | 4.07e+03  |
| Reward Loss         | -6.77e+06 |
| Running Env Steps   | 1585000   |
| Running Forward KL  | 43.9      |
| Running Reverse KL  | 46.8      |
| Running Update Time | 317       |
-----------------------------------
--2024-08-11 07:55:48.318966 UTC---
| Itration            | 318       |
| Real Det Return     | 4.5e+03   |
| Real Sto Return     | 3.91e+03  |
| Reward Loss         | -6.57e+06 |
| Running Env Steps   | 1590000   |
| Running Forward KL  | 39.1      |
| Running Reverse KL  | 177       |
| Running Update Time | 318       |
-----------------------------------
--2024-08-11 07:57:35.442613 UTC---
| Itration            | 319       |
| Real Det Return     | 4.59e+03  |
| Real Sto Return     | 4.49e+03  |
| Reward Loss         | -6.56e+06 |
| Running Env Steps   | 1595000   |
| Running Forward KL  | 38.6      |
| Running Reverse KL  | 129       |
| Running Update Time | 319       |
-----------------------------------
--2024-08-11 07:59:22.519626 UTC---
| Itration            | 320       |
| Real Det Return     | 4.54e+03  |
| Real Sto Return     | 4.2e+03   |
| Reward Loss         | -6.92e+06 |
| Running Env Steps   | 1600000   |
| Running Forward KL  | 45.1      |
| Running Reverse KL  | 130       |
| Running Update Time | 320       |
-----------------------------------
--2024-08-11 08:01:08.564160 UTC---
| Itration            | 321       |
| Real Det Return     | 4.21e+03  |
| Real Sto Return     | 3.97e+03  |
| Reward Loss         | -1.03e+07 |
| Running Env Steps   | 1605000   |
| Running Forward KL  | 43.4      |
| Running Reverse KL  | 382       |
| Running Update Time | 321       |
-----------------------------------
--2024-08-11 08:02:54.263095 UTC---
| Itration            | 322       |
| Real Det Return     | 4.22e+03  |
| Real Sto Return     | 4.14e+03  |
| Reward Loss         | -9.55e+06 |
| Running Env Steps   | 1610000   |
| Running Forward KL  | 42.4      |
| Running Reverse KL  | 522       |
| Running Update Time | 322       |
-----------------------------------
--2024-08-11 08:04:41.375423 UTC---
| Itration            | 323       |
| Real Det Return     | 4.37e+03  |
| Real Sto Return     | 4.25e+03  |
| Reward Loss         | -7.06e+06 |
| Running Env Steps   | 1615000   |
| Running Forward KL  | 38.2      |
| Running Reverse KL  | 45.4      |
| Running Update Time | 323       |
-----------------------------------
--2024-08-11 08:06:28.285202 UTC---
| Itration            | 324       |
| Real Det Return     | 4.7e+03   |
| Real Sto Return     | 4.31e+03  |
| Reward Loss         | -7.23e+06 |
| Running Env Steps   | 1620000   |
| Running Forward KL  | 41.1      |
| Running Reverse KL  | 246       |
| Running Update Time | 324       |
-----------------------------------
--2024-08-11 08:08:13.857378 UTC---
| Itration            | 325       |
| Real Det Return     | 3.98e+03  |
| Real Sto Return     | 4.02e+03  |
| Reward Loss         | -6.09e+06 |
| Running Env Steps   | 1625000   |
| Running Forward KL  | 42.5      |
| Running Reverse KL  | 52.9      |
| Running Update Time | 325       |
-----------------------------------
--2024-08-11 08:10:02.637028 UTC---
| Itration            | 326       |
| Real Det Return     | 4.43e+03  |
| Real Sto Return     | 4.48e+03  |
| Reward Loss         | -8.18e+06 |
| Running Env Steps   | 1630000   |
| Running Forward KL  | 40.6      |
| Running Reverse KL  | 144       |
| Running Update Time | 326       |
-----------------------------------
--2024-08-11 08:11:50.929730 UTC---
| Itration            | 327       |
| Real Det Return     | 4.52e+03  |
| Real Sto Return     | 4.3e+03   |
| Reward Loss         | -6.86e+06 |
| Running Env Steps   | 1635000   |
| Running Forward KL  | 37.5      |
| Running Reverse KL  | 40.1      |
| Running Update Time | 327       |
-----------------------------------
--2024-08-11 08:13:40.434724 UTC---
| Itration            | 328       |
| Real Det Return     | 4.59e+03  |
| Real Sto Return     | 4.47e+03  |
| Reward Loss         | -6.71e+06 |
| Running Env Steps   | 1640000   |
| Running Forward KL  | 44        |
| Running Reverse KL  | 48.4      |
| Running Update Time | 328       |
-----------------------------------
--2024-08-11 08:15:29.809179 UTC--
| Itration            | 329      |
| Real Det Return     | 4.63e+03 |
| Real Sto Return     | 4.47e+03 |
| Reward Loss         | -8.6e+06 |
| Running Env Steps   | 1645000  |
| Running Forward KL  | 39.5     |
| Running Reverse KL  | 283      |
| Running Update Time | 329      |
----------------------------------
--2024-08-11 08:17:18.275551 UTC---
| Itration            | 330       |
| Real Det Return     | 4.42e+03  |
| Real Sto Return     | 4.29e+03  |
| Reward Loss         | -6.24e+06 |
| Running Env Steps   | 1650000   |
| Running Forward KL  | 38        |
| Running Reverse KL  | 37.1      |
| Running Update Time | 330       |
-----------------------------------
--2024-08-11 08:19:06.871907 UTC---
| Itration            | 331       |
| Real Det Return     | 4.41e+03  |
| Real Sto Return     | 4.11e+03  |
| Reward Loss         | -6.48e+06 |
| Running Env Steps   | 1655000   |
| Running Forward KL  | 38.2      |
| Running Reverse KL  | 42        |
| Running Update Time | 331       |
-----------------------------------
--2024-08-11 08:20:56.598246 UTC---
| Itration            | 332       |
| Real Det Return     | 4.52e+03  |
| Real Sto Return     | 4.34e+03  |
| Reward Loss         | -6.31e+06 |
| Running Env Steps   | 1660000   |
| Running Forward KL  | 41.8      |
| Running Reverse KL  | 52.6      |
| Running Update Time | 332       |
-----------------------------------
--2024-08-11 08:22:45.356854 UTC---
| Itration            | 333       |
| Real Det Return     | 4.15e+03  |
| Real Sto Return     | 4.22e+03  |
| Reward Loss         | -6.44e+06 |
| Running Env Steps   | 1665000   |
| Running Forward KL  | 39.7      |
| Running Reverse KL  | 42.3      |
| Running Update Time | 333       |
-----------------------------------
--2024-08-11 08:24:34.409741 UTC---
| Itration            | 334       |
| Real Det Return     | 4.39e+03  |
| Real Sto Return     | 4.36e+03  |
| Reward Loss         | -8.23e+06 |
| Running Env Steps   | 1670000   |
| Running Forward KL  | 47.7      |
| Running Reverse KL  | 451       |
| Running Update Time | 334       |
-----------------------------------
--2024-08-11 08:26:23.908447 UTC--
| Itration            | 335      |
| Real Det Return     | 4.27e+03 |
| Real Sto Return     | 4.14e+03 |
| Reward Loss         | -6.3e+06 |
| Running Env Steps   | 1675000  |
| Running Forward KL  | 43.7     |
| Running Reverse KL  | 51.9     |
| Running Update Time | 335      |
----------------------------------
--2024-08-11 08:28:11.321857 UTC---
| Itration            | 336       |
| Real Det Return     | 3.99e+03  |
| Real Sto Return     | 3.82e+03  |
| Reward Loss         | -6.66e+06 |
| Running Env Steps   | 1680000   |
| Running Forward KL  | 37.7      |
| Running Reverse KL  | 52.2      |
| Running Update Time | 336       |
-----------------------------------
--2024-08-11 08:30:00.772262 UTC---
| Itration            | 337       |
| Real Det Return     | 4.7e+03   |
| Real Sto Return     | 4.45e+03  |
| Reward Loss         | -1.34e+07 |
| Running Env Steps   | 1685000   |
| Running Forward KL  | 43.9      |
| Running Reverse KL  | 407       |
| Running Update Time | 337       |
-----------------------------------
--2024-08-11 08:31:47.930746 UTC---
| Itration            | 338       |
| Real Det Return     | 4.16e+03  |
| Real Sto Return     | 4.24e+03  |
| Reward Loss         | -8.35e+06 |
| Running Env Steps   | 1690000   |
| Running Forward KL  | 40.1      |
| Running Reverse KL  | 482       |
| Running Update Time | 338       |
-----------------------------------
--2024-08-11 08:33:35.522559 UTC---
| Itration            | 339       |
| Real Det Return     | 4.51e+03  |
| Real Sto Return     | 3.63e+03  |
| Reward Loss         | -6.29e+06 |
| Running Env Steps   | 1695000   |
| Running Forward KL  | 41.1      |
| Running Reverse KL  | 226       |
| Running Update Time | 339       |
-----------------------------------
--2024-08-11 08:35:25.335864 UTC--
| Itration            | 340      |
| Real Det Return     | 4.61e+03 |
| Real Sto Return     | 4.33e+03 |
| Reward Loss         | -5.7e+06 |
| Running Env Steps   | 1700000  |
| Running Forward KL  | 40.2     |
| Running Reverse KL  | 43.2     |
| Running Update Time | 340      |
----------------------------------
--2024-08-11 08:37:14.363218 UTC---
| Itration            | 341       |
| Real Det Return     | 4.67e+03  |
| Real Sto Return     | 4.43e+03  |
| Reward Loss         | -6.24e+06 |
| Running Env Steps   | 1705000   |
| Running Forward KL  | 38        |
| Running Reverse KL  | 46.4      |
| Running Update Time | 341       |
-----------------------------------
--2024-08-11 08:39:04.198657 UTC--
| Itration            | 342      |
| Real Det Return     | 4.27e+03 |
| Real Sto Return     | 3.87e+03 |
| Reward Loss         | -1.1e+07 |
| Running Env Steps   | 1710000  |
| Running Forward KL  | 38.9     |
| Running Reverse KL  | 534      |
| Running Update Time | 342      |
----------------------------------
--2024-08-11 08:40:50.150356 UTC---
| Itration            | 343       |
| Real Det Return     | 3.43e+03  |
| Real Sto Return     | 3.32e+03  |
| Reward Loss         | -1.32e+07 |
| Running Env Steps   | 1715000   |
| Running Forward KL  | 41.4      |
| Running Reverse KL  | 520       |
| Running Update Time | 343       |
-----------------------------------
--2024-08-11 08:42:38.980790 UTC---
| Itration            | 344       |
| Real Det Return     | 4.6e+03   |
| Real Sto Return     | 4.14e+03  |
| Reward Loss         | -7.64e+06 |
| Running Env Steps   | 1720000   |
| Running Forward KL  | 44.2      |
| Running Reverse KL  | 130       |
| Running Update Time | 344       |
-----------------------------------
--2024-08-11 08:44:28.597790 UTC---
| Itration            | 345       |
| Real Det Return     | 4.75e+03  |
| Real Sto Return     | 4.72e+03  |
| Reward Loss         | -6.16e+06 |
| Running Env Steps   | 1725000   |
| Running Forward KL  | 37.6      |
| Running Reverse KL  | 36.7      |
| Running Update Time | 345       |
-----------------------------------
--2024-08-11 08:46:20.349070 UTC---
| Itration            | 346       |
| Real Det Return     | 4.83e+03  |
| Real Sto Return     | 4.41e+03  |
| Reward Loss         | -5.48e+06 |
| Running Env Steps   | 1730000   |
| Running Forward KL  | 38        |
| Running Reverse KL  | 44.7      |
| Running Update Time | 346       |
-----------------------------------
--2024-08-11 08:48:11.248958 UTC---
| Itration            | 347       |
| Real Det Return     | 4.37e+03  |
| Real Sto Return     | 4.34e+03  |
| Reward Loss         | -6.18e+06 |
| Running Env Steps   | 1735000   |
| Running Forward KL  | 38.8      |
| Running Reverse KL  | 47.8      |
| Running Update Time | 347       |
-----------------------------------
--2024-08-11 08:50:01.531105 UTC---
| Itration            | 348       |
| Real Det Return     | 4.75e+03  |
| Real Sto Return     | 4.56e+03  |
| Reward Loss         | -5.22e+06 |
| Running Env Steps   | 1740000   |
| Running Forward KL  | 40.8      |
| Running Reverse KL  | 45.1      |
| Running Update Time | 348       |
-----------------------------------
--2024-08-11 08:51:48.226852 UTC---
| Itration            | 349       |
| Real Det Return     | 4.48e+03  |
| Real Sto Return     | 4.23e+03  |
| Reward Loss         | -5.95e+06 |
| Running Env Steps   | 1745000   |
| Running Forward KL  | 40.5      |
| Running Reverse KL  | 289       |
| Running Update Time | 349       |
-----------------------------------
--2024-08-11 08:53:36.422943 UTC---
| Itration            | 350       |
| Real Det Return     | 4.33e+03  |
| Real Sto Return     | 4.59e+03  |
| Reward Loss         | -7.35e+06 |
| Running Env Steps   | 1750000   |
| Running Forward KL  | 44.2      |
| Running Reverse KL  | 194       |
| Running Update Time | 350       |
-----------------------------------
--2024-08-11 08:55:23.501069 UTC---
| Itration            | 351       |
| Real Det Return     | 4.72e+03  |
| Real Sto Return     | 4.31e+03  |
| Reward Loss         | -6.85e+06 |
| Running Env Steps   | 1755000   |
| Running Forward KL  | 37.3      |
| Running Reverse KL  | 141       |
| Running Update Time | 351       |
-----------------------------------
--2024-08-11 08:57:11.102008 UTC---
| Itration            | 352       |
| Real Det Return     | 4.5e+03   |
| Real Sto Return     | 4.22e+03  |
| Reward Loss         | -6.73e+06 |
| Running Env Steps   | 1760000   |
| Running Forward KL  | 41        |
| Running Reverse KL  | 46.3      |
| Running Update Time | 352       |
-----------------------------------
--2024-08-11 08:58:58.386631 UTC---
| Itration            | 353       |
| Real Det Return     | 4.68e+03  |
| Real Sto Return     | 4.49e+03  |
| Reward Loss         | -6.73e+06 |
| Running Env Steps   | 1765000   |
| Running Forward KL  | 41.9      |
| Running Reverse KL  | 240       |
| Running Update Time | 353       |
-----------------------------------
--2024-08-11 09:00:43.562873 UTC--
| Itration            | 354      |
| Real Det Return     | 3.64e+03 |
| Real Sto Return     | 3.56e+03 |
| Reward Loss         | -7.7e+06 |
| Running Env Steps   | 1770000  |
| Running Forward KL  | 41.4     |
| Running Reverse KL  | 294      |
| Running Update Time | 354      |
----------------------------------
--2024-08-11 09:02:30.709688 UTC---
| Itration            | 355       |
| Real Det Return     | 4.44e+03  |
| Real Sto Return     | 4.41e+03  |
| Reward Loss         | -9.19e+06 |
| Running Env Steps   | 1775000   |
| Running Forward KL  | 38        |
| Running Reverse KL  | 463       |
| Running Update Time | 355       |
-----------------------------------
--2024-08-11 09:04:17.738503 UTC---
| Itration            | 356       |
| Real Det Return     | 4.3e+03   |
| Real Sto Return     | 4.5e+03   |
| Reward Loss         | -5.45e+06 |
| Running Env Steps   | 1780000   |
| Running Forward KL  | 37.6      |
| Running Reverse KL  | 65        |
| Running Update Time | 356       |
-----------------------------------
--2024-08-11 09:06:05.623455 UTC---
| Itration            | 357       |
| Real Det Return     | 4.61e+03  |
| Real Sto Return     | 4.49e+03  |
| Reward Loss         | -9.43e+06 |
| Running Env Steps   | 1785000   |
| Running Forward KL  | 38.6      |
| Running Reverse KL  | 328       |
| Running Update Time | 357       |
-----------------------------------
--2024-08-11 09:07:53.621120 UTC---
| Itration            | 358       |
| Real Det Return     | 4.72e+03  |
| Real Sto Return     | 4.36e+03  |
| Reward Loss         | -5.46e+06 |
| Running Env Steps   | 1790000   |
| Running Forward KL  | 35        |
| Running Reverse KL  | 41.9      |
| Running Update Time | 358       |
-----------------------------------
--2024-08-11 09:09:41.658169 UTC---
| Itration            | 359       |
| Real Det Return     | 4.73e+03  |
| Real Sto Return     | 4.46e+03  |
| Reward Loss         | -5.91e+06 |
| Running Env Steps   | 1795000   |
| Running Forward KL  | 35.2      |
| Running Reverse KL  | 41.6      |
| Running Update Time | 359       |
-----------------------------------
--2024-08-11 09:11:29.112009 UTC---
| Itration            | 360       |
| Real Det Return     | 4.2e+03   |
| Real Sto Return     | 4.25e+03  |
| Reward Loss         | -5.95e+06 |
| Running Env Steps   | 1800000   |
| Running Forward KL  | 39.3      |
| Running Reverse KL  | 46        |
| Running Update Time | 360       |
-----------------------------------
--2024-08-11 09:13:16.323638 UTC---
| Itration            | 361       |
| Real Det Return     | 4.33e+03  |
| Real Sto Return     | 4.14e+03  |
| Reward Loss         | -6.66e+06 |
| Running Env Steps   | 1805000   |
| Running Forward KL  | 37.9      |
| Running Reverse KL  | 38.7      |
| Running Update Time | 361       |
-----------------------------------
--2024-08-11 09:15:02.564695 UTC---
| Itration            | 362       |
| Real Det Return     | 4.38e+03  |
| Real Sto Return     | 4.13e+03  |
| Reward Loss         | -1.48e+07 |
| Running Env Steps   | 1810000   |
| Running Forward KL  | 39.5      |
| Running Reverse KL  | 856       |
| Running Update Time | 362       |
-----------------------------------
--2024-08-11 09:16:49.145431 UTC---
| Itration            | 363       |
| Real Det Return     | 4.48e+03  |
| Real Sto Return     | 4.16e+03  |
| Reward Loss         | -6.08e+06 |
| Running Env Steps   | 1815000   |
| Running Forward KL  | 36.4      |
| Running Reverse KL  | 136       |
| Running Update Time | 363       |
-----------------------------------
--2024-08-11 09:18:35.929660 UTC---
| Itration            | 364       |
| Real Det Return     | 3.98e+03  |
| Real Sto Return     | 4.32e+03  |
| Reward Loss         | -8.38e+06 |
| Running Env Steps   | 1820000   |
| Running Forward KL  | 41        |
| Running Reverse KL  | 186       |
| Running Update Time | 364       |
-----------------------------------
--2024-08-11 09:20:22.056956 UTC---
| Itration            | 365       |
| Real Det Return     | 4.27e+03  |
| Real Sto Return     | 3.85e+03  |
| Reward Loss         | -7.07e+06 |
| Running Env Steps   | 1825000   |
| Running Forward KL  | 36.2      |
| Running Reverse KL  | 38.6      |
| Running Update Time | 365       |
-----------------------------------
--2024-08-11 09:22:09.879153 UTC---
| Itration            | 366       |
| Real Det Return     | 4.43e+03  |
| Real Sto Return     | 4.52e+03  |
| Reward Loss         | -6.72e+06 |
| Running Env Steps   | 1830000   |
| Running Forward KL  | 39.4      |
| Running Reverse KL  | 151       |
| Running Update Time | 366       |
-----------------------------------
--2024-08-11 09:23:58.635868 UTC---
| Itration            | 367       |
| Real Det Return     | 4.77e+03  |
| Real Sto Return     | 4.6e+03   |
| Reward Loss         | -6.25e+06 |
| Running Env Steps   | 1835000   |
| Running Forward KL  | 41.8      |
| Running Reverse KL  | 49.7      |
| Running Update Time | 367       |
-----------------------------------
--2024-08-11 09:25:46.189828 UTC---
| Itration            | 368       |
| Real Det Return     | 4.79e+03  |
| Real Sto Return     | 4.02e+03  |
| Reward Loss         | -6.89e+06 |
| Running Env Steps   | 1840000   |
| Running Forward KL  | 35.9      |
| Running Reverse KL  | 82.1      |
| Running Update Time | 368       |
-----------------------------------
--2024-08-11 09:27:32.697045 UTC---
| Itration            | 369       |
| Real Det Return     | 4.49e+03  |
| Real Sto Return     | 4.37e+03  |
| Reward Loss         | -1.15e+07 |
| Running Env Steps   | 1845000   |
| Running Forward KL  | 36.7      |
| Running Reverse KL  | 534       |
| Running Update Time | 369       |
-----------------------------------
--2024-08-11 09:29:20.117695 UTC---
| Itration            | 370       |
| Real Det Return     | 4.14e+03  |
| Real Sto Return     | 4.53e+03  |
| Reward Loss         | -6.24e+06 |
| Running Env Steps   | 1850000   |
| Running Forward KL  | 37.5      |
| Running Reverse KL  | 126       |
| Running Update Time | 370       |
-----------------------------------
--2024-08-11 09:31:08.925671 UTC---
| Itration            | 371       |
| Real Det Return     | 4.56e+03  |
| Real Sto Return     | 4.57e+03  |
| Reward Loss         | -5.97e+06 |
| Running Env Steps   | 1855000   |
| Running Forward KL  | 42.8      |
| Running Reverse KL  | 70.5      |
| Running Update Time | 371       |
-----------------------------------
--2024-08-11 09:32:56.653407 UTC---
| Itration            | 372       |
| Real Det Return     | 4.47e+03  |
| Real Sto Return     | 4.41e+03  |
| Reward Loss         | -6.11e+06 |
| Running Env Steps   | 1860000   |
| Running Forward KL  | 35.5      |
| Running Reverse KL  | 39.5      |
| Running Update Time | 372       |
-----------------------------------
--2024-08-11 09:34:43.020901 UTC---
| Itration            | 373       |
| Real Det Return     | 4.16e+03  |
| Real Sto Return     | 4.31e+03  |
| Reward Loss         | -7.14e+06 |
| Running Env Steps   | 1865000   |
| Running Forward KL  | 35.9      |
| Running Reverse KL  | 387       |
| Running Update Time | 373       |
-----------------------------------
--2024-08-11 09:36:30.202893 UTC---
| Itration            | 374       |
| Real Det Return     | 4.32e+03  |
| Real Sto Return     | 4e+03     |
| Reward Loss         | -6.91e+06 |
| Running Env Steps   | 1870000   |
| Running Forward KL  | 38        |
| Running Reverse KL  | 38.9      |
| Running Update Time | 374       |
-----------------------------------
--2024-08-11 09:38:19.001160 UTC---
| Itration            | 375       |
| Real Det Return     | 4.66e+03  |
| Real Sto Return     | 4.43e+03  |
| Reward Loss         | -5.89e+06 |
| Running Env Steps   | 1875000   |
| Running Forward KL  | 37.5      |
| Running Reverse KL  | 212       |
| Running Update Time | 375       |
-----------------------------------
--2024-08-11 09:40:06.425542 UTC---
| Itration            | 376       |
| Real Det Return     | 4.36e+03  |
| Real Sto Return     | 4.2e+03   |
| Reward Loss         | -1.09e+07 |
| Running Env Steps   | 1880000   |
| Running Forward KL  | 38.3      |
| Running Reverse KL  | 264       |
| Running Update Time | 376       |
-----------------------------------
--2024-08-11 09:41:53.896560 UTC---
| Itration            | 377       |
| Real Det Return     | 4.58e+03  |
| Real Sto Return     | 4.1e+03   |
| Reward Loss         | -6.18e+06 |
| Running Env Steps   | 1885000   |
| Running Forward KL  | 35.6      |
| Running Reverse KL  | 37.4      |
| Running Update Time | 377       |
-----------------------------------
--2024-08-11 09:43:42.561807 UTC---
| Itration            | 378       |
| Real Det Return     | 4.91e+03  |
| Real Sto Return     | 4.64e+03  |
| Reward Loss         | -8.83e+06 |
| Running Env Steps   | 1890000   |
| Running Forward KL  | 38.3      |
| Running Reverse KL  | 250       |
| Running Update Time | 378       |
-----------------------------------
--2024-08-11 09:45:31.062811 UTC---
| Itration            | 379       |
| Real Det Return     | 4.72e+03  |
| Real Sto Return     | 4.51e+03  |
| Reward Loss         | -6.39e+06 |
| Running Env Steps   | 1895000   |
| Running Forward KL  | 36.4      |
| Running Reverse KL  | 277       |
| Running Update Time | 379       |
-----------------------------------
--2024-08-11 09:47:20.084021 UTC--
| Itration            | 380      |
| Real Det Return     | 4.89e+03 |
| Real Sto Return     | 4.71e+03 |
| Reward Loss         | -6.4e+06 |
| Running Env Steps   | 1900000  |
| Running Forward KL  | 33.5     |
| Running Reverse KL  | 34       |
| Running Update Time | 380      |
----------------------------------
--2024-08-11 09:49:07.301025 UTC---
| Itration            | 381       |
| Real Det Return     | 4.77e+03  |
| Real Sto Return     | 3.64e+03  |
| Reward Loss         | -8.09e+06 |
| Running Env Steps   | 1905000   |
| Running Forward KL  | 39.4      |
| Running Reverse KL  | 250       |
| Running Update Time | 381       |
-----------------------------------
--2024-08-11 09:50:56.380153 UTC---
| Itration            | 382       |
| Real Det Return     | 4.5e+03   |
| Real Sto Return     | 4.6e+03   |
| Reward Loss         | -6.61e+06 |
| Running Env Steps   | 1910000   |
| Running Forward KL  | 39.8      |
| Running Reverse KL  | 48.4      |
| Running Update Time | 382       |
-----------------------------------
--2024-08-11 09:52:46.142379 UTC---
| Itration            | 383       |
| Real Det Return     | 4.69e+03  |
| Real Sto Return     | 4.42e+03  |
| Reward Loss         | -6.74e+06 |
| Running Env Steps   | 1915000   |
| Running Forward KL  | 39.2      |
| Running Reverse KL  | 50.3      |
| Running Update Time | 383       |
-----------------------------------
--2024-08-11 09:54:35.387417 UTC---
| Itration            | 384       |
| Real Det Return     | 4.96e+03  |
| Real Sto Return     | 4.7e+03   |
| Reward Loss         | -6.16e+06 |
| Running Env Steps   | 1920000   |
| Running Forward KL  | 34.3      |
| Running Reverse KL  | 55        |
| Running Update Time | 384       |
-----------------------------------
--2024-08-11 09:56:25.490541 UTC---
| Itration            | 385       |
| Real Det Return     | 4.69e+03  |
| Real Sto Return     | 4.61e+03  |
| Reward Loss         | -6.49e+06 |
| Running Env Steps   | 1925000   |
| Running Forward KL  | 39.3      |
| Running Reverse KL  | 43.5      |
| Running Update Time | 385       |
-----------------------------------
--2024-08-11 09:58:14.333980 UTC---
| Itration            | 386       |
| Real Det Return     | 4.66e+03  |
| Real Sto Return     | 4.64e+03  |
| Reward Loss         | -5.12e+06 |
| Running Env Steps   | 1930000   |
| Running Forward KL  | 37        |
| Running Reverse KL  | 142       |
| Running Update Time | 386       |
-----------------------------------
--2024-08-11 10:00:00.471266 UTC---
| Itration            | 387       |
| Real Det Return     | 3.86e+03  |
| Real Sto Return     | 3.93e+03  |
| Reward Loss         | -9.64e+06 |
| Running Env Steps   | 1935000   |
| Running Forward KL  | 40.3      |
| Running Reverse KL  | 469       |
| Running Update Time | 387       |
-----------------------------------
--2024-08-11 10:01:48.829642 UTC---
| Itration            | 388       |
| Real Det Return     | 4.31e+03  |
| Real Sto Return     | 4.11e+03  |
| Reward Loss         | -6.36e+06 |
| Running Env Steps   | 1940000   |
| Running Forward KL  | 37.4      |
| Running Reverse KL  | 44.5      |
| Running Update Time | 388       |
-----------------------------------
--2024-08-11 10:03:38.831737 UTC---
| Itration            | 389       |
| Real Det Return     | 4.85e+03  |
| Real Sto Return     | 4.62e+03  |
| Reward Loss         | -6.16e+06 |
| Running Env Steps   | 1945000   |
| Running Forward KL  | 35.5      |
| Running Reverse KL  | 40        |
| Running Update Time | 389       |
-----------------------------------
--2024-08-11 10:05:26.900460 UTC--
| Itration            | 390      |
| Real Det Return     | 4.68e+03 |
| Real Sto Return     | 3.9e+03  |
| Reward Loss         | -5.9e+06 |
| Running Env Steps   | 1950000  |
| Running Forward KL  | 37.1     |
| Running Reverse KL  | 289      |
| Running Update Time | 390      |
----------------------------------
--2024-08-11 10:07:16.671977 UTC--
| Itration            | 391      |
| Real Det Return     | 4.78e+03 |
| Real Sto Return     | 4.77e+03 |
| Reward Loss         | -5e+06   |
| Running Env Steps   | 1955000  |
| Running Forward KL  | 33.6     |
| Running Reverse KL  | 119      |
| Running Update Time | 391      |
----------------------------------
--2024-08-11 10:09:06.277729 UTC---
| Itration            | 392       |
| Real Det Return     | 4.85e+03  |
| Real Sto Return     | 4.62e+03  |
| Reward Loss         | -5.46e+06 |
| Running Env Steps   | 1960000   |
| Running Forward KL  | 37.6      |
| Running Reverse KL  | 95.9      |
| Running Update Time | 392       |
-----------------------------------
--2024-08-11 10:10:55.549724 UTC---
| Itration            | 393       |
| Real Det Return     | 4.8e+03   |
| Real Sto Return     | 4.5e+03   |
| Reward Loss         | -5.52e+06 |
| Running Env Steps   | 1965000   |
| Running Forward KL  | 36.2      |
| Running Reverse KL  | 37.1      |
| Running Update Time | 393       |
-----------------------------------
--2024-08-11 10:12:45.823388 UTC---
| Itration            | 394       |
| Real Det Return     | 4.79e+03  |
| Real Sto Return     | 4.13e+03  |
| Reward Loss         | -6.53e+06 |
| Running Env Steps   | 1970000   |
| Running Forward KL  | 35.9      |
| Running Reverse KL  | 42.7      |
| Running Update Time | 394       |
-----------------------------------
--2024-08-11 10:14:35.215359 UTC---
| Itration            | 395       |
| Real Det Return     | 4.82e+03  |
| Real Sto Return     | 4.24e+03  |
| Reward Loss         | -4.55e+06 |
| Running Env Steps   | 1975000   |
| Running Forward KL  | 30.3      |
| Running Reverse KL  | 30.3      |
| Running Update Time | 395       |
-----------------------------------
--2024-08-11 10:16:23.866429 UTC---
| Itration            | 396       |
| Real Det Return     | 4.34e+03  |
| Real Sto Return     | 4.52e+03  |
| Reward Loss         | -7.94e+06 |
| Running Env Steps   | 1980000   |
| Running Forward KL  | 35.8      |
| Running Reverse KL  | 238       |
| Running Update Time | 396       |
-----------------------------------
--2024-08-11 10:18:12.642611 UTC---
| Itration            | 397       |
| Real Det Return     | 5.11e+03  |
| Real Sto Return     | 4.41e+03  |
| Reward Loss         | -5.42e+06 |
| Running Env Steps   | 1985000   |
| Running Forward KL  | 34.4      |
| Running Reverse KL  | 38.3      |
| Running Update Time | 397       |
-----------------------------------
--2024-08-11 10:20:01.804664 UTC---
| Itration            | 398       |
| Real Det Return     | 4.55e+03  |
| Real Sto Return     | 4.63e+03  |
| Reward Loss         | -6.51e+06 |
| Running Env Steps   | 1990000   |
| Running Forward KL  | 37.7      |
| Running Reverse KL  | 257       |
| Running Update Time | 398       |
-----------------------------------
--2024-08-11 10:21:50.857849 UTC---
| Itration            | 399       |
| Real Det Return     | 4.9e+03   |
| Real Sto Return     | 4.15e+03  |
| Reward Loss         | -1.08e+07 |
| Running Env Steps   | 1995000   |
| Running Forward KL  | 40.1      |
| Running Reverse KL  | 632       |
| Running Update Time | 399       |
-----------------------------------
--2024-08-11 10:23:40.544637 UTC---
| Itration            | 400       |
| Real Det Return     | 4.72e+03  |
| Real Sto Return     | 4.44e+03  |
| Reward Loss         | -6.17e+06 |
| Running Env Steps   | 2000000   |
| Running Forward KL  | 37.5      |
| Running Reverse KL  | 38.6      |
| Running Update Time | 400       |
-----------------------------------
--2024-08-11 10:25:30.224282 UTC---
| Itration            | 401       |
| Real Det Return     | 4.9e+03   |
| Real Sto Return     | 4.49e+03  |
| Reward Loss         | -8.94e+06 |
| Running Env Steps   | 2005000   |
| Running Forward KL  | 37.2      |
| Running Reverse KL  | 391       |
| Running Update Time | 401       |
-----------------------------------
--2024-08-11 10:27:21.366312 UTC---
| Itration            | 402       |
| Real Det Return     | 4.79e+03  |
| Real Sto Return     | 4.62e+03  |
| Reward Loss         | -6.67e+06 |
| Running Env Steps   | 2010000   |
| Running Forward KL  | 37.7      |
| Running Reverse KL  | 182       |
| Running Update Time | 402       |
-----------------------------------
--2024-08-11 10:29:10.082947 UTC---
| Itration            | 403       |
| Real Det Return     | 4.8e+03   |
| Real Sto Return     | 4.36e+03  |
| Reward Loss         | -8.98e+06 |
| Running Env Steps   | 2015000   |
| Running Forward KL  | 40.3      |
| Running Reverse KL  | 527       |
| Running Update Time | 403       |
-----------------------------------
--2024-08-11 10:31:00.147960 UTC---
| Itration            | 404       |
| Real Det Return     | 4.79e+03  |
| Real Sto Return     | 4.63e+03  |
| Reward Loss         | -5.74e+06 |
| Running Env Steps   | 2020000   |
| Running Forward KL  | 41.6      |
| Running Reverse KL  | 72.5      |
| Running Update Time | 404       |
-----------------------------------
--2024-08-11 10:32:49.632051 UTC---
| Itration            | 405       |
| Real Det Return     | 4.56e+03  |
| Real Sto Return     | 4.54e+03  |
| Reward Loss         | -5.24e+06 |
| Running Env Steps   | 2025000   |
| Running Forward KL  | 37.2      |
| Running Reverse KL  | 42.4      |
| Running Update Time | 405       |
-----------------------------------
--2024-08-11 10:34:38.168627 UTC---
| Itration            | 406       |
| Real Det Return     | 4.85e+03  |
| Real Sto Return     | 4.43e+03  |
| Reward Loss         | -1.07e+07 |
| Running Env Steps   | 2030000   |
| Running Forward KL  | 39.5      |
| Running Reverse KL  | 425       |
| Running Update Time | 406       |
-----------------------------------
--2024-08-11 10:36:27.716843 UTC---
| Itration            | 407       |
| Real Det Return     | 4.99e+03  |
| Real Sto Return     | 4.58e+03  |
| Reward Loss         | -5.81e+06 |
| Running Env Steps   | 2035000   |
| Running Forward KL  | 34.9      |
| Running Reverse KL  | 37.6      |
| Running Update Time | 407       |
-----------------------------------
--2024-08-11 10:38:16.945386 UTC---
| Itration            | 408       |
| Real Det Return     | 4.45e+03  |
| Real Sto Return     | 4.39e+03  |
| Reward Loss         | -6.19e+06 |
| Running Env Steps   | 2040000   |
| Running Forward KL  | 37.5      |
| Running Reverse KL  | 37.5      |
| Running Update Time | 408       |
-----------------------------------
--2024-08-11 10:40:07.332837 UTC---
| Itration            | 409       |
| Real Det Return     | 4.66e+03  |
| Real Sto Return     | 4.7e+03   |
| Reward Loss         | -5.51e+06 |
| Running Env Steps   | 2045000   |
| Running Forward KL  | 37.9      |
| Running Reverse KL  | 39.8      |
| Running Update Time | 409       |
-----------------------------------
--2024-08-11 10:41:57.368542 UTC---
| Itration            | 410       |
| Real Det Return     | 4.91e+03  |
| Real Sto Return     | 4.71e+03  |
| Reward Loss         | -6.01e+06 |
| Running Env Steps   | 2050000   |
| Running Forward KL  | 39.3      |
| Running Reverse KL  | 149       |
| Running Update Time | 410       |
-----------------------------------
--2024-08-11 10:43:47.588751 UTC---
| Itration            | 411       |
| Real Det Return     | 4.96e+03  |
| Real Sto Return     | 4.81e+03  |
| Reward Loss         | -7.25e+06 |
| Running Env Steps   | 2055000   |
| Running Forward KL  | 38.5      |
| Running Reverse KL  | 278       |
| Running Update Time | 411       |
-----------------------------------
--2024-08-11 10:45:38.174866 UTC---
| Itration            | 412       |
| Real Det Return     | 4.83e+03  |
| Real Sto Return     | 4.7e+03   |
| Reward Loss         | -6.15e+06 |
| Running Env Steps   | 2060000   |
| Running Forward KL  | 42        |
| Running Reverse KL  | 47.9      |
| Running Update Time | 412       |
-----------------------------------
--2024-08-11 10:47:27.741757 UTC---
| Itration            | 413       |
| Real Det Return     | 4.92e+03  |
| Real Sto Return     | 4.47e+03  |
| Reward Loss         | -5.75e+06 |
| Running Env Steps   | 2065000   |
| Running Forward KL  | 35.8      |
| Running Reverse KL  | 43.6      |
| Running Update Time | 413       |
-----------------------------------
--2024-08-11 10:49:17.662649 UTC---
| Itration            | 414       |
| Real Det Return     | 5.09e+03  |
| Real Sto Return     | 4.55e+03  |
| Reward Loss         | -7.88e+06 |
| Running Env Steps   | 2070000   |
| Running Forward KL  | 38.7      |
| Running Reverse KL  | 221       |
| Running Update Time | 414       |
-----------------------------------
--2024-08-11 10:51:07.144843 UTC---
| Itration            | 415       |
| Real Det Return     | 4.96e+03  |
| Real Sto Return     | 4.62e+03  |
| Reward Loss         | -5.12e+06 |
| Running Env Steps   | 2075000   |
| Running Forward KL  | 36.5      |
| Running Reverse KL  | 202       |
| Running Update Time | 415       |
-----------------------------------
--2024-08-11 10:52:57.132504 UTC---
| Itration            | 416       |
| Real Det Return     | 5e+03     |
| Real Sto Return     | 4.51e+03  |
| Reward Loss         | -4.17e+06 |
| Running Env Steps   | 2080000   |
| Running Forward KL  | 35.8      |
| Running Reverse KL  | 34.1      |
| Running Update Time | 416       |
-----------------------------------
--2024-08-11 10:54:47.290649 UTC---
| Itration            | 417       |
| Real Det Return     | 4.9e+03   |
| Real Sto Return     | 4.78e+03  |
| Reward Loss         | -1.01e+07 |
| Running Env Steps   | 2085000   |
| Running Forward KL  | 34.9      |
| Running Reverse KL  | 412       |
| Running Update Time | 417       |
-----------------------------------
--2024-08-11 10:56:37.404195 UTC--
| Itration            | 418      |
| Real Det Return     | 5.02e+03 |
| Real Sto Return     | 4.39e+03 |
| Reward Loss         | -5e+06   |
| Running Env Steps   | 2090000  |
| Running Forward KL  | 36       |
| Running Reverse KL  | 38.2     |
| Running Update Time | 418      |
----------------------------------
--2024-08-11 10:58:28.205590 UTC---
| Itration            | 419       |
| Real Det Return     | 5e+03     |
| Real Sto Return     | 4.77e+03  |
| Reward Loss         | -5.04e+06 |
| Running Env Steps   | 2095000   |
| Running Forward KL  | 36.7      |
| Running Reverse KL  | 36.5      |
| Running Update Time | 419       |
-----------------------------------
--2024-08-11 11:00:18.473300 UTC---
| Itration            | 420       |
| Real Det Return     | 4.84e+03  |
| Real Sto Return     | 4.57e+03  |
| Reward Loss         | -6.23e+06 |
| Running Env Steps   | 2100000   |
| Running Forward KL  | 37.9      |
| Running Reverse KL  | 38.6      |
| Running Update Time | 420       |
-----------------------------------
--2024-08-11 11:02:07.328816 UTC---
| Itration            | 421       |
| Real Det Return     | 4.33e+03  |
| Real Sto Return     | 4.45e+03  |
| Reward Loss         | -5.17e+06 |
| Running Env Steps   | 2105000   |
| Running Forward KL  | 34.4      |
| Running Reverse KL  | 93.8      |
| Running Update Time | 421       |
-----------------------------------
--2024-08-11 11:03:57.690074 UTC---
| Itration            | 422       |
| Real Det Return     | 5.06e+03  |
| Real Sto Return     | 4.55e+03  |
| Reward Loss         | -4.57e+06 |
| Running Env Steps   | 2110000   |
| Running Forward KL  | 36.5      |
| Running Reverse KL  | 36.3      |
| Running Update Time | 422       |
-----------------------------------
--2024-08-11 11:05:48.183454 UTC---
| Itration            | 423       |
| Real Det Return     | 4.87e+03  |
| Real Sto Return     | 4.7e+03   |
| Reward Loss         | -5.27e+06 |
| Running Env Steps   | 2115000   |
| Running Forward KL  | 36.5      |
| Running Reverse KL  | 48.1      |
| Running Update Time | 423       |
-----------------------------------
--2024-08-11 11:07:38.477204 UTC---
| Itration            | 424       |
| Real Det Return     | 4.89e+03  |
| Real Sto Return     | 5.04e+03  |
| Reward Loss         | -5.14e+06 |
| Running Env Steps   | 2120000   |
| Running Forward KL  | 31.5      |
| Running Reverse KL  | 30.3      |
| Running Update Time | 424       |
-----------------------------------
--2024-08-11 11:09:28.772109 UTC---
| Itration            | 425       |
| Real Det Return     | 5.09e+03  |
| Real Sto Return     | 4.58e+03  |
| Reward Loss         | -5.17e+06 |
| Running Env Steps   | 2125000   |
| Running Forward KL  | 35.4      |
| Running Reverse KL  | 33.9      |
| Running Update Time | 425       |
-----------------------------------
--2024-08-11 11:11:18.582629 UTC---
| Itration            | 426       |
| Real Det Return     | 4.79e+03  |
| Real Sto Return     | 4.57e+03  |
| Reward Loss         | -8.02e+06 |
| Running Env Steps   | 2130000   |
| Running Forward KL  | 40.9      |
| Running Reverse KL  | 278       |
| Running Update Time | 426       |
-----------------------------------
--2024-08-11 11:13:08.418012 UTC---
| Itration            | 427       |
| Real Det Return     | 4.96e+03  |
| Real Sto Return     | 4.47e+03  |
| Reward Loss         | -3.64e+06 |
| Running Env Steps   | 2135000   |
| Running Forward KL  | 31.6      |
| Running Reverse KL  | 26.7      |
| Running Update Time | 427       |
-----------------------------------
--2024-08-11 11:15:00.141523 UTC---
| Itration            | 428       |
| Real Det Return     | 4.73e+03  |
| Real Sto Return     | 4.42e+03  |
| Reward Loss         | -4.08e+06 |
| Running Env Steps   | 2140000   |
| Running Forward KL  | 34.9      |
| Running Reverse KL  | 37.5      |
| Running Update Time | 428       |
-----------------------------------
--2024-08-11 11:16:51.742548 UTC---
| Itration            | 429       |
| Real Det Return     | 5.03e+03  |
| Real Sto Return     | 4.64e+03  |
| Reward Loss         | -4.54e+06 |
| Running Env Steps   | 2145000   |
| Running Forward KL  | 33.8      |
| Running Reverse KL  | 35.4      |
| Running Update Time | 429       |
-----------------------------------
--2024-08-11 11:18:44.791853 UTC--
| Itration            | 430      |
| Real Det Return     | 4.94e+03 |
| Real Sto Return     | 4.95e+03 |
| Reward Loss         | -5e+06   |
| Running Env Steps   | 2150000  |
| Running Forward KL  | 36.1     |
| Running Reverse KL  | 36.5     |
| Running Update Time | 430      |
----------------------------------
--2024-08-11 11:20:39.194701 UTC---
| Itration            | 431       |
| Real Det Return     | 5.01e+03  |
| Real Sto Return     | 4.41e+03  |
| Reward Loss         | -5.08e+06 |
| Running Env Steps   | 2155000   |
| Running Forward KL  | 35.1      |
| Running Reverse KL  | 73.2      |
| Running Update Time | 431       |
-----------------------------------
--2024-08-11 11:22:33.038063 UTC---
| Itration            | 432       |
| Real Det Return     | 4.94e+03  |
| Real Sto Return     | 4.53e+03  |
| Reward Loss         | -6.25e+06 |
| Running Env Steps   | 2160000   |
| Running Forward KL  | 35.2      |
| Running Reverse KL  | 57        |
| Running Update Time | 432       |
-----------------------------------
--2024-08-11 11:24:24.803657 UTC---
| Itration            | 433       |
| Real Det Return     | 5.01e+03  |
| Real Sto Return     | 4.72e+03  |
| Reward Loss         | -4.79e+06 |
| Running Env Steps   | 2165000   |
| Running Forward KL  | 36        |
| Running Reverse KL  | 37.5      |
| Running Update Time | 433       |
-----------------------------------
--2024-08-11 11:26:17.410889 UTC--
| Itration            | 434      |
| Real Det Return     | 5.19e+03 |
| Real Sto Return     | 4.81e+03 |
| Reward Loss         | -5.7e+06 |
| Running Env Steps   | 2170000  |
| Running Forward KL  | 34       |
| Running Reverse KL  | 88.6     |
| Running Update Time | 434      |
----------------------------------
--2024-08-11 11:28:08.591814 UTC--
| Itration            | 435      |
| Real Det Return     | 4.4e+03  |
| Real Sto Return     | 4.17e+03 |
| Reward Loss         | -6.9e+06 |
| Running Env Steps   | 2175000  |
| Running Forward KL  | 36.7     |
| Running Reverse KL  | 134      |
| Running Update Time | 435      |
----------------------------------
--2024-08-11 11:30:00.803834 UTC--
| Itration            | 436      |
| Real Det Return     | 5.22e+03 |
| Real Sto Return     | 4.69e+03 |
| Reward Loss         | -4.2e+06 |
| Running Env Steps   | 2180000  |
| Running Forward KL  | 33.5     |
| Running Reverse KL  | 31.5     |
| Running Update Time | 436      |
----------------------------------
--2024-08-11 11:31:51.608033 UTC---
| Itration            | 437       |
| Real Det Return     | 4.68e+03  |
| Real Sto Return     | 4.13e+03  |
| Reward Loss         | -1.03e+07 |
| Running Env Steps   | 2185000   |
| Running Forward KL  | 38.4      |
| Running Reverse KL  | 389       |
| Running Update Time | 437       |
-----------------------------------
--2024-08-11 11:33:44.096705 UTC---
| Itration            | 438       |
| Real Det Return     | 4.87e+03  |
| Real Sto Return     | 4.9e+03   |
| Reward Loss         | -8.07e+06 |
| Running Env Steps   | 2190000   |
| Running Forward KL  | 36.9      |
| Running Reverse KL  | 599       |
| Running Update Time | 438       |
-----------------------------------
--2024-08-11 11:35:36.976864 UTC---
| Itration            | 439       |
| Real Det Return     | 4.94e+03  |
| Real Sto Return     | 4.97e+03  |
| Reward Loss         | -6.12e+06 |
| Running Env Steps   | 2195000   |
| Running Forward KL  | 32.3      |
| Running Reverse KL  | 255       |
| Running Update Time | 439       |
-----------------------------------
--2024-08-11 11:37:29.031661 UTC---
| Itration            | 440       |
| Real Det Return     | 5.07e+03  |
| Real Sto Return     | 4.78e+03  |
| Reward Loss         | -4.18e+06 |
| Running Env Steps   | 2200000   |
| Running Forward KL  | 33.2      |
| Running Reverse KL  | 318       |
| Running Update Time | 440       |
-----------------------------------
--2024-08-11 11:39:20.997282 UTC---
| Itration            | 441       |
| Real Det Return     | 4.66e+03  |
| Real Sto Return     | 4.85e+03  |
| Reward Loss         | -4.77e+06 |
| Running Env Steps   | 2205000   |
| Running Forward KL  | 34        |
| Running Reverse KL  | 28.1      |
| Running Update Time | 441       |
-----------------------------------
--2024-08-11 11:41:13.022926 UTC---
| Itration            | 442       |
| Real Det Return     | 5e+03     |
| Real Sto Return     | 4.26e+03  |
| Reward Loss         | -5.31e+06 |
| Running Env Steps   | 2210000   |
| Running Forward KL  | 35.2      |
| Running Reverse KL  | 36.2      |
| Running Update Time | 442       |
-----------------------------------
--2024-08-11 11:43:05.499653 UTC---
| Itration            | 443       |
| Real Det Return     | 4.86e+03  |
| Real Sto Return     | 4.71e+03  |
| Reward Loss         | -4.49e+06 |
| Running Env Steps   | 2215000   |
| Running Forward KL  | 35.7      |
| Running Reverse KL  | 37.1      |
| Running Update Time | 443       |
-----------------------------------
--2024-08-11 11:44:58.196700 UTC--
| Itration            | 444      |
| Real Det Return     | 5.03e+03 |
| Real Sto Return     | 4.7e+03  |
| Reward Loss         | -5.2e+06 |
| Running Env Steps   | 2220000  |
| Running Forward KL  | 36.7     |
| Running Reverse KL  | 39.2     |
| Running Update Time | 444      |
----------------------------------
--2024-08-11 11:46:49.759004 UTC---
| Itration            | 445       |
| Real Det Return     | 4.53e+03  |
| Real Sto Return     | 4.37e+03  |
| Reward Loss         | -6.83e+06 |
| Running Env Steps   | 2225000   |
| Running Forward KL  | 35        |
| Running Reverse KL  | 268       |
| Running Update Time | 445       |
-----------------------------------
--2024-08-11 11:48:42.362341 UTC---
| Itration            | 446       |
| Real Det Return     | 5.21e+03  |
| Real Sto Return     | 4.58e+03  |
| Reward Loss         | -4.81e+06 |
| Running Env Steps   | 2230000   |
| Running Forward KL  | 31.8      |
| Running Reverse KL  | 36.1      |
| Running Update Time | 446       |
-----------------------------------
--2024-08-11 11:50:35.009473 UTC---
| Itration            | 447       |
| Real Det Return     | 4.94e+03  |
| Real Sto Return     | 4.75e+03  |
| Reward Loss         | -6.84e+06 |
| Running Env Steps   | 2235000   |
| Running Forward KL  | 37.6      |
| Running Reverse KL  | 290       |
| Running Update Time | 447       |
-----------------------------------
--2024-08-11 11:52:27.788270 UTC---
| Itration            | 448       |
| Real Det Return     | 5.24e+03  |
| Real Sto Return     | 4.68e+03  |
| Reward Loss         | -5.45e+06 |
| Running Env Steps   | 2240000   |
| Running Forward KL  | 33.5      |
| Running Reverse KL  | 153       |
| Running Update Time | 448       |
-----------------------------------
--2024-08-11 11:54:16.997142 UTC---
| Itration            | 449       |
| Real Det Return     | 4.99e+03  |
| Real Sto Return     | 4.2e+03   |
| Reward Loss         | -9.68e+06 |
| Running Env Steps   | 2245000   |
| Running Forward KL  | 36.9      |
| Running Reverse KL  | 493       |
| Running Update Time | 449       |
-----------------------------------
--2024-08-11 11:56:06.126003 UTC---
| Itration            | 450       |
| Real Det Return     | 4.62e+03  |
| Real Sto Return     | 4.24e+03  |
| Reward Loss         | -5.89e+06 |
| Running Env Steps   | 2250000   |
| Running Forward KL  | 35.2      |
| Running Reverse KL  | 398       |
| Running Update Time | 450       |
-----------------------------------
--2024-08-11 11:57:56.984279 UTC---
| Itration            | 451       |
| Real Det Return     | 4.9e+03   |
| Real Sto Return     | 4.16e+03  |
| Reward Loss         | -5.67e+06 |
| Running Env Steps   | 2255000   |
| Running Forward KL  | 34.4      |
| Running Reverse KL  | 83.7      |
| Running Update Time | 451       |
-----------------------------------
--2024-08-11 11:59:49.333325 UTC---
| Itration            | 452       |
| Real Det Return     | 4.9e+03   |
| Real Sto Return     | 4.74e+03  |
| Reward Loss         | -4.36e+06 |
| Running Env Steps   | 2260000   |
| Running Forward KL  | 32.6      |
| Running Reverse KL  | 31        |
| Running Update Time | 452       |
-----------------------------------
--2024-08-11 12:01:42.693007 UTC--
| Itration            | 453      |
| Real Det Return     | 5.24e+03 |
| Real Sto Return     | 4.98e+03 |
| Reward Loss         | -5.1e+06 |
| Running Env Steps   | 2265000  |
| Running Forward KL  | 34.8     |
| Running Reverse KL  | 35.5     |
| Running Update Time | 453      |
----------------------------------
--2024-08-11 12:03:32.618256 UTC---
| Itration            | 454       |
| Real Det Return     | 4.72e+03  |
| Real Sto Return     | 3.89e+03  |
| Reward Loss         | -8.03e+06 |
| Running Env Steps   | 2270000   |
| Running Forward KL  | 38.3      |
| Running Reverse KL  | 901       |
| Running Update Time | 454       |
-----------------------------------
--2024-08-11 12:05:24.733728 UTC---
| Itration            | 455       |
| Real Det Return     | 4.84e+03  |
| Real Sto Return     | 4.68e+03  |
| Reward Loss         | -6.18e+06 |
| Running Env Steps   | 2275000   |
| Running Forward KL  | 36.6      |
| Running Reverse KL  | 135       |
| Running Update Time | 455       |
-----------------------------------
--2024-08-11 12:07:17.725516 UTC---
| Itration            | 456       |
| Real Det Return     | 5.1e+03   |
| Real Sto Return     | 4.5e+03   |
| Reward Loss         | -3.96e+06 |
| Running Env Steps   | 2280000   |
| Running Forward KL  | 31.7      |
| Running Reverse KL  | 34.4      |
| Running Update Time | 456       |
-----------------------------------
--2024-08-11 12:09:10.652893 UTC---
| Itration            | 457       |
| Real Det Return     | 5.35e+03  |
| Real Sto Return     | 4.8e+03   |
| Reward Loss         | -3.86e+06 |
| Running Env Steps   | 2285000   |
| Running Forward KL  | 31.1      |
| Running Reverse KL  | 27.1      |
| Running Update Time | 457       |
-----------------------------------
--2024-08-11 12:11:03.115472 UTC---
| Itration            | 458       |
| Real Det Return     | 4.97e+03  |
| Real Sto Return     | 4.79e+03  |
| Reward Loss         | -6.35e+06 |
| Running Env Steps   | 2290000   |
| Running Forward KL  | 34.6      |
| Running Reverse KL  | 213       |
| Running Update Time | 458       |
-----------------------------------
--2024-08-11 12:12:55.175669 UTC--
| Itration            | 459      |
| Real Det Return     | 5.03e+03 |
| Real Sto Return     | 4.68e+03 |
| Reward Loss         | -5.1e+06 |
| Running Env Steps   | 2295000  |
| Running Forward KL  | 33.9     |
| Running Reverse KL  | 175      |
| Running Update Time | 459      |
----------------------------------
--2024-08-11 12:14:47.493997 UTC---
| Itration            | 460       |
| Real Det Return     | 4.94e+03  |
| Real Sto Return     | 4.61e+03  |
| Reward Loss         | -7.09e+06 |
| Running Env Steps   | 2300000   |
| Running Forward KL  | 35        |
| Running Reverse KL  | 255       |
| Running Update Time | 460       |
-----------------------------------
--2024-08-11 12:16:40.245061 UTC---
| Itration            | 461       |
| Real Det Return     | 4.88e+03  |
| Real Sto Return     | 4.64e+03  |
| Reward Loss         | -5.85e+06 |
| Running Env Steps   | 2305000   |
| Running Forward KL  | 31.7      |
| Running Reverse KL  | 32.4      |
| Running Update Time | 461       |
-----------------------------------
--2024-08-11 12:18:33.617787 UTC--
| Itration            | 462      |
| Real Det Return     | 5.01e+03 |
| Real Sto Return     | 4.86e+03 |
| Reward Loss         | -6.7e+06 |
| Running Env Steps   | 2310000  |
| Running Forward KL  | 33.5     |
| Running Reverse KL  | 146      |
| Running Update Time | 462      |
----------------------------------
--2024-08-11 12:20:27.373621 UTC---
| Itration            | 463       |
| Real Det Return     | 5.17e+03  |
| Real Sto Return     | 5.01e+03  |
| Reward Loss         | -6.32e+06 |
| Running Env Steps   | 2315000   |
| Running Forward KL  | 31.7      |
| Running Reverse KL  | 125       |
| Running Update Time | 463       |
-----------------------------------
--2024-08-11 12:22:19.135351 UTC---
| Itration            | 464       |
| Real Det Return     | 5.05e+03  |
| Real Sto Return     | 4.13e+03  |
| Reward Loss         | -5.71e+06 |
| Running Env Steps   | 2320000   |
| Running Forward KL  | 31.8      |
| Running Reverse KL  | 109       |
| Running Update Time | 464       |
-----------------------------------
--2024-08-11 12:24:12.300863 UTC--
| Itration            | 465      |
| Real Det Return     | 5.33e+03 |
| Real Sto Return     | 4.75e+03 |
| Reward Loss         | -5.1e+06 |
| Running Env Steps   | 2325000  |
| Running Forward KL  | 37.1     |
| Running Reverse KL  | 42.7     |
| Running Update Time | 465      |
----------------------------------
--2024-08-11 12:26:06.002557 UTC---
| Itration            | 466       |
| Real Det Return     | 5.31e+03  |
| Real Sto Return     | 5.07e+03  |
| Reward Loss         | -4.39e+06 |
| Running Env Steps   | 2330000   |
| Running Forward KL  | 32.2      |
| Running Reverse KL  | 131       |
| Running Update Time | 466       |
-----------------------------------
--2024-08-11 12:27:59.378922 UTC---
| Itration            | 467       |
| Real Det Return     | 5.24e+03  |
| Real Sto Return     | 4.95e+03  |
| Reward Loss         | -4.59e+06 |
| Running Env Steps   | 2335000   |
| Running Forward KL  | 34.9      |
| Running Reverse KL  | 32.2      |
| Running Update Time | 467       |
-----------------------------------
--2024-08-11 12:29:52.659034 UTC---
| Itration            | 468       |
| Real Det Return     | 5.1e+03   |
| Real Sto Return     | 4.8e+03   |
| Reward Loss         | -3.91e+06 |
| Running Env Steps   | 2340000   |
| Running Forward KL  | 34.5      |
| Running Reverse KL  | 25.9      |
| Running Update Time | 468       |
-----------------------------------
--2024-08-11 12:31:45.042091 UTC---
| Itration            | 469       |
| Real Det Return     | 5.02e+03  |
| Real Sto Return     | 4.26e+03  |
| Reward Loss         | -7.08e+06 |
| Running Env Steps   | 2345000   |
| Running Forward KL  | 34        |
| Running Reverse KL  | 54.7      |
| Running Update Time | 469       |
-----------------------------------
--2024-08-11 12:33:38.248628 UTC---
| Itration            | 470       |
| Real Det Return     | 5.26e+03  |
| Real Sto Return     | 4.93e+03  |
| Reward Loss         | -5.16e+06 |
| Running Env Steps   | 2350000   |
| Running Forward KL  | 34.4      |
| Running Reverse KL  | 114       |
| Running Update Time | 470       |
-----------------------------------
--2024-08-11 12:35:31.951469 UTC---
| Itration            | 471       |
| Real Det Return     | 5.35e+03  |
| Real Sto Return     | 4.9e+03   |
| Reward Loss         | -3.91e+06 |
| Running Env Steps   | 2355000   |
| Running Forward KL  | 31.8      |
| Running Reverse KL  | 99.2      |
| Running Update Time | 471       |
-----------------------------------
--2024-08-11 12:37:25.186141 UTC---
| Itration            | 472       |
| Real Det Return     | 5.21e+03  |
| Real Sto Return     | 4.93e+03  |
| Reward Loss         | -3.89e+06 |
| Running Env Steps   | 2360000   |
| Running Forward KL  | 33.1      |
| Running Reverse KL  | 32.4      |
| Running Update Time | 472       |
-----------------------------------
--2024-08-11 12:39:17.699167 UTC---
| Itration            | 473       |
| Real Det Return     | 5.32e+03  |
| Real Sto Return     | 4.54e+03  |
| Reward Loss         | -4.46e+06 |
| Running Env Steps   | 2365000   |
| Running Forward KL  | 31.9      |
| Running Reverse KL  | 24.5      |
| Running Update Time | 473       |
-----------------------------------
--2024-08-11 12:41:11.535217 UTC--
| Itration            | 474      |
| Real Det Return     | 5.42e+03 |
| Real Sto Return     | 5.14e+03 |
| Reward Loss         | -6.1e+06 |
| Running Env Steps   | 2370000  |
| Running Forward KL  | 30.5     |
| Running Reverse KL  | 259      |
| Running Update Time | 474      |
----------------------------------
--2024-08-11 12:43:05.202856 UTC---
| Itration            | 475       |
| Real Det Return     | 4.99e+03  |
| Real Sto Return     | 4.86e+03  |
| Reward Loss         | -6.08e+06 |
| Running Env Steps   | 2375000   |
| Running Forward KL  | 37.2      |
| Running Reverse KL  | 151       |
| Running Update Time | 475       |
-----------------------------------
--2024-08-11 12:44:58.362782 UTC---
| Itration            | 476       |
| Real Det Return     | 5.35e+03  |
| Real Sto Return     | 5.01e+03  |
| Reward Loss         | -4.17e+06 |
| Running Env Steps   | 2380000   |
| Running Forward KL  | 33.1      |
| Running Reverse KL  | 36.5      |
| Running Update Time | 476       |
-----------------------------------
--2024-08-11 12:46:51.758891 UTC---
| Itration            | 477       |
| Real Det Return     | 5.18e+03  |
| Real Sto Return     | 4.75e+03  |
| Reward Loss         | -1.94e+06 |
| Running Env Steps   | 2385000   |
| Running Forward KL  | 33.5      |
| Running Reverse KL  | 233       |
| Running Update Time | 477       |
-----------------------------------
--2024-08-11 12:48:44.796600 UTC---
| Itration            | 478       |
| Real Det Return     | 5.34e+03  |
| Real Sto Return     | 4.71e+03  |
| Reward Loss         | -4.38e+06 |
| Running Env Steps   | 2390000   |
| Running Forward KL  | 34.6      |
| Running Reverse KL  | 191       |
| Running Update Time | 478       |
-----------------------------------
--2024-08-11 12:50:36.091765 UTC---
| Itration            | 479       |
| Real Det Return     | 5.06e+03  |
| Real Sto Return     | 4.31e+03  |
| Reward Loss         | -3.56e+06 |
| Running Env Steps   | 2395000   |
| Running Forward KL  | 32.7      |
| Running Reverse KL  | 296       |
| Running Update Time | 479       |
-----------------------------------
--2024-08-11 12:52:28.718656 UTC--
| Itration            | 480      |
| Real Det Return     | 5.45e+03 |
| Real Sto Return     | 4.95e+03 |
| Reward Loss         | -4.1e+06 |
| Running Env Steps   | 2400000  |
| Running Forward KL  | 30.8     |
| Running Reverse KL  | 27.5     |
| Running Update Time | 480      |
----------------------------------
--2024-08-11 12:54:20.832672 UTC---
| Itration            | 481       |
| Real Det Return     | 5.38e+03  |
| Real Sto Return     | 4.36e+03  |
| Reward Loss         | -3.54e+06 |
| Running Env Steps   | 2405000   |
| Running Forward KL  | 31.7      |
| Running Reverse KL  | 28.6      |
| Running Update Time | 481       |
-----------------------------------
--2024-08-11 12:56:13.847694 UTC---
| Itration            | 482       |
| Real Det Return     | 5.36e+03  |
| Real Sto Return     | 5.03e+03  |
| Reward Loss         | -3.32e+06 |
| Running Env Steps   | 2410000   |
| Running Forward KL  | 36.2      |
| Running Reverse KL  | 32        |
| Running Update Time | 482       |
-----------------------------------
--2024-08-11 12:58:06.807697 UTC---
| Itration            | 483       |
| Real Det Return     | 5.2e+03   |
| Real Sto Return     | 4.56e+03  |
| Reward Loss         | -4.58e+06 |
| Running Env Steps   | 2415000   |
| Running Forward KL  | 33.4      |
| Running Reverse KL  | 31.6      |
| Running Update Time | 483       |
-----------------------------------
--2024-08-11 12:59:57.436580 UTC---
| Itration            | 484       |
| Real Det Return     | 4.68e+03  |
| Real Sto Return     | 4.14e+03  |
| Reward Loss         | -4.62e+06 |
| Running Env Steps   | 2420000   |
| Running Forward KL  | 33.3      |
| Running Reverse KL  | 464       |
| Running Update Time | 484       |
-----------------------------------
--2024-08-11 13:01:49.786416 UTC--
| Itration            | 485      |
| Real Det Return     | 5.17e+03 |
| Real Sto Return     | 4.49e+03 |
| Reward Loss         | -6.6e+06 |
| Running Env Steps   | 2425000  |
| Running Forward KL  | 35.8     |
| Running Reverse KL  | 149      |
| Running Update Time | 485      |
----------------------------------
--2024-08-11 13:03:42.185424 UTC---
| Itration            | 486       |
| Real Det Return     | 4.78e+03  |
| Real Sto Return     | 4.73e+03  |
| Reward Loss         | -4.55e+06 |
| Running Env Steps   | 2430000   |
| Running Forward KL  | 31.2      |
| Running Reverse KL  | 46        |
| Running Update Time | 486       |
-----------------------------------
--2024-08-11 13:05:36.056631 UTC---
| Itration            | 487       |
| Real Det Return     | 5.44e+03  |
| Real Sto Return     | 5.19e+03  |
| Reward Loss         | -3.68e+06 |
| Running Env Steps   | 2435000   |
| Running Forward KL  | 31.8      |
| Running Reverse KL  | 32.4      |
| Running Update Time | 487       |
-----------------------------------
--2024-08-11 13:07:28.400115 UTC---
| Itration            | 488       |
| Real Det Return     | 4.81e+03  |
| Real Sto Return     | 5.02e+03  |
| Reward Loss         | -6.14e+06 |
| Running Env Steps   | 2440000   |
| Running Forward KL  | 33.5      |
| Running Reverse KL  | 228       |
| Running Update Time | 488       |
-----------------------------------
--2024-08-11 13:09:21.691047 UTC---
| Itration            | 489       |
| Real Det Return     | 5.49e+03  |
| Real Sto Return     | 5.04e+03  |
| Reward Loss         | -3.99e+06 |
| Running Env Steps   | 2445000   |
| Running Forward KL  | 34        |
| Running Reverse KL  | 241       |
| Running Update Time | 489       |
-----------------------------------
--2024-08-11 13:11:14.697124 UTC---
| Itration            | 490       |
| Real Det Return     | 5.18e+03  |
| Real Sto Return     | 4.85e+03  |
| Reward Loss         | -4.18e+06 |
| Running Env Steps   | 2450000   |
| Running Forward KL  | 32.2      |
| Running Reverse KL  | 231       |
| Running Update Time | 490       |
-----------------------------------
--2024-08-11 13:13:08.120116 UTC---
| Itration            | 491       |
| Real Det Return     | 5.09e+03  |
| Real Sto Return     | 5.04e+03  |
| Reward Loss         | -4.52e+06 |
| Running Env Steps   | 2455000   |
| Running Forward KL  | 32.7      |
| Running Reverse KL  | 120       |
| Running Update Time | 491       |
-----------------------------------
--2024-08-11 13:15:01.222842 UTC---
| Itration            | 492       |
| Real Det Return     | 5.38e+03  |
| Real Sto Return     | 4.93e+03  |
| Reward Loss         | -4.73e+06 |
| Running Env Steps   | 2460000   |
| Running Forward KL  | 29.3      |
| Running Reverse KL  | 33.5      |
| Running Update Time | 492       |
-----------------------------------
--2024-08-11 13:16:54.015204 UTC---
| Itration            | 493       |
| Real Det Return     | 5.41e+03  |
| Real Sto Return     | 4.79e+03  |
| Reward Loss         | -3.32e+06 |
| Running Env Steps   | 2465000   |
| Running Forward KL  | 29.9      |
| Running Reverse KL  | 28.3      |
| Running Update Time | 493       |
-----------------------------------
--2024-08-11 13:18:45.771828 UTC---
| Itration            | 494       |
| Real Det Return     | 4.79e+03  |
| Real Sto Return     | 4.64e+03  |
| Reward Loss         | -3.17e+06 |
| Running Env Steps   | 2470000   |
| Running Forward KL  | 30.6      |
| Running Reverse KL  | 26.8      |
| Running Update Time | 494       |
-----------------------------------
--2024-08-11 13:20:38.207491 UTC---
| Itration            | 495       |
| Real Det Return     | 5.42e+03  |
| Real Sto Return     | 4.9e+03   |
| Reward Loss         | -3.69e+06 |
| Running Env Steps   | 2475000   |
| Running Forward KL  | 30.9      |
| Running Reverse KL  | 128       |
| Running Update Time | 495       |
-----------------------------------
--2024-08-11 13:22:31.355470 UTC---
| Itration            | 496       |
| Real Det Return     | 5.46e+03  |
| Real Sto Return     | 4.96e+03  |
| Reward Loss         | -2.34e+06 |
| Running Env Steps   | 2480000   |
| Running Forward KL  | 32.1      |
| Running Reverse KL  | 28.3      |
| Running Update Time | 496       |
-----------------------------------
--2024-08-11 13:24:24.973643 UTC---
| Itration            | 497       |
| Real Det Return     | 5.31e+03  |
| Real Sto Return     | 5.18e+03  |
| Reward Loss         | -3.13e+06 |
| Running Env Steps   | 2485000   |
| Running Forward KL  | 34.3      |
| Running Reverse KL  | 26.7      |
| Running Update Time | 497       |
-----------------------------------
--2024-08-11 13:26:18.394649 UTC---
| Itration            | 498       |
| Real Det Return     | 5.5e+03   |
| Real Sto Return     | 5.19e+03  |
| Reward Loss         | -2.38e+06 |
| Running Env Steps   | 2490000   |
| Running Forward KL  | 33.2      |
| Running Reverse KL  | 27.5      |
| Running Update Time | 498       |
-----------------------------------
--2024-08-11 13:28:11.407509 UTC---
| Itration            | 499       |
| Real Det Return     | 5.62e+03  |
| Real Sto Return     | 5.05e+03  |
| Reward Loss         | -1.73e+06 |
| Running Env Steps   | 2495000   |
| Running Forward KL  | 29.7      |
| Running Reverse KL  | 37.4      |
| Running Update Time | 499       |
-----------------------------------
--2024-08-11 13:30:04.473596 UTC---
| Itration            | 500       |
| Real Det Return     | 5.29e+03  |
| Real Sto Return     | 5.12e+03  |
| Reward Loss         | -2.26e+06 |
| Running Env Steps   | 2500000   |
| Running Forward KL  | 33.5      |
| Running Reverse KL  | 28        |
| Running Update Time | 500       |
-----------------------------------
--2024-08-11 13:31:56.567224 UTC---
| Itration            | 501       |
| Real Det Return     | 5.49e+03  |
| Real Sto Return     | 4.87e+03  |
| Reward Loss         | -2.34e+06 |
| Running Env Steps   | 2505000   |
| Running Forward KL  | 29.6      |
| Running Reverse KL  | 27.8      |
| Running Update Time | 501       |
-----------------------------------
--2024-08-11 13:33:49.333963 UTC---
| Itration            | 502       |
| Real Det Return     | 5.38e+03  |
| Real Sto Return     | 5.11e+03  |
| Reward Loss         | -3.53e+06 |
| Running Env Steps   | 2510000   |
| Running Forward KL  | 31        |
| Running Reverse KL  | 33.7      |
| Running Update Time | 502       |
-----------------------------------
--2024-08-11 13:35:40.835630 UTC--
| Itration            | 503      |
| Real Det Return     | 5.51e+03 |
| Real Sto Return     | 4.58e+03 |
| Reward Loss         | -8e+06   |
| Running Env Steps   | 2515000  |
| Running Forward KL  | 34       |
| Running Reverse KL  | 255      |
| Running Update Time | 503      |
----------------------------------
--2024-08-11 13:37:32.864179 UTC---
| Itration            | 504       |
| Real Det Return     | 4.79e+03  |
| Real Sto Return     | 4.95e+03  |
| Reward Loss         | -4.63e+06 |
| Running Env Steps   | 2520000   |
| Running Forward KL  | 38.2      |
| Running Reverse KL  | 192       |
| Running Update Time | 504       |
-----------------------------------
--2024-08-11 13:39:25.292886 UTC---
| Itration            | 505       |
| Real Det Return     | 5.27e+03  |
| Real Sto Return     | 4.95e+03  |
| Reward Loss         | -8.03e+06 |
| Running Env Steps   | 2525000   |
| Running Forward KL  | 32.9      |
| Running Reverse KL  | 269       |
| Running Update Time | 505       |
-----------------------------------
--2024-08-11 13:41:15.923265 UTC---
| Itration            | 506       |
| Real Det Return     | 5.26e+03  |
| Real Sto Return     | 4.24e+03  |
| Reward Loss         | -3.14e+06 |
| Running Env Steps   | 2530000   |
| Running Forward KL  | 31.9      |
| Running Reverse KL  | 259       |
| Running Update Time | 506       |
-----------------------------------
--2024-08-11 13:43:07.060340 UTC---
| Itration            | 507       |
| Real Det Return     | 5.4e+03   |
| Real Sto Return     | 4.46e+03  |
| Reward Loss         | -3.64e+06 |
| Running Env Steps   | 2535000   |
| Running Forward KL  | 33.6      |
| Running Reverse KL  | 374       |
| Running Update Time | 507       |
-----------------------------------
--2024-08-11 13:44:59.666121 UTC---
| Itration            | 508       |
| Real Det Return     | 5.36e+03  |
| Real Sto Return     | 5.26e+03  |
| Reward Loss         | -2.33e+06 |
| Running Env Steps   | 2540000   |
| Running Forward KL  | 31.3      |
| Running Reverse KL  | 52.6      |
| Running Update Time | 508       |
-----------------------------------
--2024-08-11 13:46:52.373753 UTC---
| Itration            | 509       |
| Real Det Return     | 5.38e+03  |
| Real Sto Return     | 4.66e+03  |
| Reward Loss         | -3.56e+06 |
| Running Env Steps   | 2545000   |
| Running Forward KL  | 32.3      |
| Running Reverse KL  | 321       |
| Running Update Time | 509       |
-----------------------------------
--2024-08-11 13:48:45.389952 UTC---
| Itration            | 510       |
| Real Det Return     | 5.02e+03  |
| Real Sto Return     | 4.9e+03   |
| Reward Loss         | -1.11e+06 |
| Running Env Steps   | 2550000   |
| Running Forward KL  | 31.2      |
| Running Reverse KL  | 27.9      |
| Running Update Time | 510       |
-----------------------------------
--2024-08-11 13:50:37.806442 UTC---
| Itration            | 511       |
| Real Det Return     | 5.05e+03  |
| Real Sto Return     | 4.18e+03  |
| Reward Loss         | -6.87e+06 |
| Running Env Steps   | 2555000   |
| Running Forward KL  | 30.1      |
| Running Reverse KL  | 199       |
| Running Update Time | 511       |
-----------------------------------
--2024-08-11 13:52:30.670834 UTC--
| Itration            | 512      |
| Real Det Return     | 5.37e+03 |
| Real Sto Return     | 4.62e+03 |
| Reward Loss         | -4.1e+06 |
| Running Env Steps   | 2560000  |
| Running Forward KL  | 32.5     |
| Running Reverse KL  | 129      |
| Running Update Time | 512      |
----------------------------------
--2024-08-11 13:54:33.632166 UTC---
| Itration            | 513       |
| Real Det Return     | -2.94e+03 |
| Real Sto Return     | -2.91e+03 |
| Reward Loss         | -5.51e+07 |
| Running Env Steps   | 2565000   |
| Running Forward KL  | 175       |
| Running Reverse KL  | 1e+03     |
| Running Update Time | 513       |
-----------------------------------
--2024-08-11 13:56:35.764358 UTC---
| Itration            | 514       |
| Real Det Return     | -2.98e+03 |
| Real Sto Return     | -2.98e+03 |
| Reward Loss         | -5.13e+07 |
| Running Env Steps   | 2570000   |
| Running Forward KL  | 172       |
| Running Reverse KL  | 1.21e+03  |
| Running Update Time | 514       |
-----------------------------------
--2024-08-11 13:58:28.985258 UTC---
| Itration            | 515       |
| Real Det Return     | -2.13e+03 |
| Real Sto Return     | -2.18e+03 |
| Reward Loss         | -5.26e+07 |
| Running Env Steps   | 2575000   |
| Running Forward KL  | 142       |
| Running Reverse KL  | 1.16e+03  |
| Running Update Time | 515       |
-----------------------------------
--2024-08-11 14:00:26.187875 UTC---
| Itration            | 516       |
| Real Det Return     | -2.59e+03 |
| Real Sto Return     | -2.36e+03 |
| Reward Loss         | -4.67e+07 |
| Running Env Steps   | 2580000   |
| Running Forward KL  | 142       |
| Running Reverse KL  | 942       |
| Running Update Time | 516       |
-----------------------------------
--2024-08-11 14:02:06.902996 UTC---
| Itration            | 517       |
| Real Det Return     | -674      |
| Real Sto Return     | -443      |
| Reward Loss         | -5.84e+07 |
| Running Env Steps   | 2585000   |
| Running Forward KL  | 147       |
| Running Reverse KL  | 2.28e+03  |
| Running Update Time | 517       |
-----------------------------------
--2024-08-11 14:03:59.022146 UTC---
| Itration            | 518       |
| Real Det Return     | -1.94e+03 |
| Real Sto Return     | -2.12e+03 |
| Reward Loss         | -5.72e+07 |
| Running Env Steps   | 2590000   |
| Running Forward KL  | 161       |
| Running Reverse KL  | 1.76e+03  |
| Running Update Time | 518       |
-----------------------------------
--2024-08-11 14:05:57.273390 UTC---
| Itration            | 519       |
| Real Det Return     | -2.47e+03 |
| Real Sto Return     | -2.7e+03  |
| Reward Loss         | -5.21e+07 |
| Running Env Steps   | 2595000   |
| Running Forward KL  | 163       |
| Running Reverse KL  | 1.25e+03  |
| Running Update Time | 519       |
-----------------------------------
--2024-08-11 14:07:56.427213 UTC---
| Itration            | 520       |
| Real Det Return     | -2.18e+03 |
| Real Sto Return     | -2.07e+03 |
| Reward Loss         | -5.64e+07 |
| Running Env Steps   | 2600000   |
| Running Forward KL  | 160       |
| Running Reverse KL  | 804       |
| Running Update Time | 520       |
-----------------------------------
--2024-08-11 14:09:44.942465 UTC---
| Itration            | 521       |
| Real Det Return     | -1.35e+03 |
| Real Sto Return     | -1.71e+03 |
| Reward Loss         | -5.88e+07 |
| Running Env Steps   | 2605000   |
| Running Forward KL  | 148       |
| Running Reverse KL  | 1.77e+03  |
| Running Update Time | 521       |
-----------------------------------
--2024-08-11 14:11:38.795908 UTC---
| Itration            | 522       |
| Real Det Return     | -1.99e+03 |
| Real Sto Return     | -1.69e+03 |
| Reward Loss         | -5.98e+07 |
| Running Env Steps   | 2610000   |
| Running Forward KL  | 163       |
| Running Reverse KL  | 1.1e+03   |
| Running Update Time | 522       |
-----------------------------------
--2024-08-11 14:13:27.141391 UTC---
| Itration            | 523       |
| Real Det Return     | -1.21e+03 |
| Real Sto Return     | -1.1e+03  |
| Reward Loss         | -6.22e+07 |
| Running Env Steps   | 2615000   |
| Running Forward KL  | 157       |
| Running Reverse KL  | 1.55e+03  |
| Running Update Time | 523       |
-----------------------------------
--2024-08-11 14:15:20.235207 UTC---
| Itration            | 524       |
| Real Det Return     | -1.8e+03  |
| Real Sto Return     | -1.49e+03 |
| Reward Loss         | -5.66e+07 |
| Running Env Steps   | 2620000   |
| Running Forward KL  | 120       |
| Running Reverse KL  | 893       |
| Running Update Time | 524       |
-----------------------------------
--2024-08-11 14:17:13.790384 UTC---
| Itration            | 525       |
| Real Det Return     | -1.63e+03 |
| Real Sto Return     | -1.1e+03  |
| Reward Loss         | -6.08e+07 |
| Running Env Steps   | 2625000   |
| Running Forward KL  | 134       |
| Running Reverse KL  | 898       |
| Running Update Time | 525       |
-----------------------------------
--2024-08-11 14:18:58.015337 UTC---
| Itration            | 526       |
| Real Det Return     | -773      |
| Real Sto Return     | -1.07e+03 |
| Reward Loss         | -5.85e+07 |
| Running Env Steps   | 2630000   |
| Running Forward KL  | 124       |
| Running Reverse KL  | 1.57e+03  |
| Running Update Time | 526       |
-----------------------------------
--2024-08-11 14:20:42.419831 UTC---
| Itration            | 527       |
| Real Det Return     | -878      |
| Real Sto Return     | -1.2e+03  |
| Reward Loss         | -5.62e+07 |
| Running Env Steps   | 2635000   |
| Running Forward KL  | 129       |
| Running Reverse KL  | 2.09e+03  |
| Running Update Time | 527       |
-----------------------------------
--2024-08-11 14:22:29.094300 UTC---
| Itration            | 528       |
| Real Det Return     | -1.24e+03 |
| Real Sto Return     | -1.09e+03 |
| Reward Loss         | -5.77e+07 |
| Running Env Steps   | 2640000   |
| Running Forward KL  | 121       |
| Running Reverse KL  | 1.05e+03  |
| Running Update Time | 528       |
-----------------------------------
--2024-08-11 14:24:18.412644 UTC---
| Itration            | 529       |
| Real Det Return     | -1.01e+03 |
| Real Sto Return     | -1.03e+03 |
| Reward Loss         | -5.95e+07 |
| Running Env Steps   | 2645000   |
| Running Forward KL  | 122       |
| Running Reverse KL  | 1.57e+03  |
| Running Update Time | 529       |
-----------------------------------
--2024-08-11 14:26:07.112477 UTC---
| Itration            | 530       |
| Real Det Return     | -1.2e+03  |
| Real Sto Return     | -715      |
| Reward Loss         | -6.23e+07 |
| Running Env Steps   | 2650000   |
| Running Forward KL  | 136       |
| Running Reverse KL  | 1.34e+03  |
| Running Update Time | 530       |
-----------------------------------
--2024-08-11 14:28:01.680840 UTC---
| Itration            | 531       |
| Real Det Return     | -1.14e+03 |
| Real Sto Return     | -966      |
| Reward Loss         | -6.29e+07 |
| Running Env Steps   | 2655000   |
| Running Forward KL  | 131       |
| Running Reverse KL  | 1.21e+03  |
| Running Update Time | 531       |
-----------------------------------
--2024-08-11 14:29:59.291672 UTC---
| Itration            | 532       |
| Real Det Return     | -1.42e+03 |
| Real Sto Return     | -1.43e+03 |
| Reward Loss         | -6.27e+07 |
| Running Env Steps   | 2660000   |
| Running Forward KL  | 130       |
| Running Reverse KL  | 886       |
| Running Update Time | 532       |
-----------------------------------
--2024-08-11 14:31:52.095786 UTC---
| Itration            | 533       |
| Real Det Return     | -1e+03    |
| Real Sto Return     | -921      |
| Reward Loss         | -6.38e+07 |
| Running Env Steps   | 2665000   |
| Running Forward KL  | 127       |
| Running Reverse KL  | 1.07e+03  |
| Running Update Time | 533       |
-----------------------------------
--2024-08-11 14:33:45.213787 UTC---
| Itration            | 534       |
| Real Det Return     | -676      |
| Real Sto Return     | -995      |
| Reward Loss         | -6.22e+07 |
| Running Env Steps   | 2670000   |
| Running Forward KL  | 122       |
| Running Reverse KL  | 895       |
| Running Update Time | 534       |
-----------------------------------
--2024-08-11 14:35:41.872403 UTC---
| Itration            | 535       |
| Real Det Return     | -480      |
| Real Sto Return     | -461      |
| Reward Loss         | -6.36e+07 |
| Running Env Steps   | 2675000   |
| Running Forward KL  | 135       |
| Running Reverse KL  | 633       |
| Running Update Time | 535       |
-----------------------------------
--2024-08-11 14:37:38.523003 UTC---
| Itration            | 536       |
| Real Det Return     | -1.26e+03 |
| Real Sto Return     | -1.49e+03 |
| Reward Loss         | -6.26e+07 |
| Running Env Steps   | 2680000   |
| Running Forward KL  | 124       |
| Running Reverse KL  | 854       |
| Running Update Time | 536       |
-----------------------------------
--2024-08-11 14:39:35.467483 UTC---
| Itration            | 537       |
| Real Det Return     | -1.1e+03  |
| Real Sto Return     | -1.42e+03 |
| Reward Loss         | -6.23e+07 |
| Running Env Steps   | 2685000   |
| Running Forward KL  | 105       |
| Running Reverse KL  | 647       |
| Running Update Time | 537       |
-----------------------------------
--2024-08-11 14:41:33.022091 UTC---
| Itration            | 538       |
| Real Det Return     | -695      |
| Real Sto Return     | -1.02e+03 |
| Reward Loss         | -6.7e+07  |
| Running Env Steps   | 2690000   |
| Running Forward KL  | 121       |
| Running Reverse KL  | 369       |
| Running Update Time | 538       |
-----------------------------------
--2024-08-11 14:43:23.961905 UTC---
| Itration            | 539       |
| Real Det Return     | -712      |
| Real Sto Return     | -570      |
| Reward Loss         | -5.59e+07 |
| Running Env Steps   | 2695000   |
| Running Forward KL  | 100       |
| Running Reverse KL  | 1.03e+03  |
| Running Update Time | 539       |
-----------------------------------
--2024-08-11 14:45:15.240805 UTC---
| Itration            | 540       |
| Real Det Return     | -632      |
| Real Sto Return     | -510      |
| Reward Loss         | -6.48e+07 |
| Running Env Steps   | 2700000   |
| Running Forward KL  | 99.3      |
| Running Reverse KL  | 732       |
| Running Update Time | 540       |
-----------------------------------
--2024-08-11 14:47:07.022630 UTC---
| Itration            | 541       |
| Real Det Return     | -654      |
| Real Sto Return     | -573      |
| Reward Loss         | -5.84e+07 |
| Running Env Steps   | 2705000   |
| Running Forward KL  | 89.8      |
| Running Reverse KL  | 1.01e+03  |
| Running Update Time | 541       |
-----------------------------------
--2024-08-11 14:49:01.470652 UTC---
| Itration            | 542       |
| Real Det Return     | -933      |
| Real Sto Return     | -970      |
| Reward Loss         | -5.89e+07 |
| Running Env Steps   | 2710000   |
| Running Forward KL  | 98.7      |
| Running Reverse KL  | 758       |
| Running Update Time | 542       |
-----------------------------------
--2024-08-11 14:50:51.794514 UTC---
| Itration            | 543       |
| Real Det Return     | -244      |
| Real Sto Return     | -328      |
| Reward Loss         | -4.95e+07 |
| Running Env Steps   | 2715000   |
| Running Forward KL  | 96.8      |
| Running Reverse KL  | 1.64e+03  |
| Running Update Time | 543       |
-----------------------------------
--2024-08-11 14:52:43.662562 UTC---
| Itration            | 544       |
| Real Det Return     | 16.6      |
| Real Sto Return     | 261       |
| Reward Loss         | -4.94e+07 |
| Running Env Steps   | 2720000   |
| Running Forward KL  | 72.6      |
| Running Reverse KL  | 534       |
| Running Update Time | 544       |
-----------------------------------
--2024-08-11 14:54:29.734974 UTC---
| Itration            | 545       |
| Real Det Return     | 271       |
| Real Sto Return     | 269       |
| Reward Loss         | -4.63e+07 |
| Running Env Steps   | 2725000   |
| Running Forward KL  | 75.7      |
| Running Reverse KL  | 1.58e+03  |
| Running Update Time | 545       |
-----------------------------------
--2024-08-11 14:56:18.878122 UTC---
| Itration            | 546       |
| Real Det Return     | -32.1     |
| Real Sto Return     | 336       |
| Reward Loss         | -4.47e+07 |
| Running Env Steps   | 2730000   |
| Running Forward KL  | 67.6      |
| Running Reverse KL  | 837       |
| Running Update Time | 546       |
-----------------------------------
--2024-08-11 14:58:05.390681 UTC---
| Itration            | 547       |
| Real Det Return     | 624       |
| Real Sto Return     | 617       |
| Reward Loss         | -3.46e+07 |
| Running Env Steps   | 2735000   |
| Running Forward KL  | 62        |
| Running Reverse KL  | 1.31e+03  |
| Running Update Time | 547       |
-----------------------------------
--2024-08-11 14:59:48.898398 UTC---
| Itration            | 548       |
| Real Det Return     | -210      |
| Real Sto Return     | -250      |
| Reward Loss         | -4.75e+07 |
| Running Env Steps   | 2740000   |
| Running Forward KL  | 78.8      |
| Running Reverse KL  | 1.39e+03  |
| Running Update Time | 548       |
-----------------------------------
--2024-08-11 15:01:36.407503 UTC--
| Itration            | 549      |
| Real Det Return     | 307      |
| Real Sto Return     | 352      |
| Reward Loss         | -4.8e+07 |
| Running Env Steps   | 2745000  |
| Running Forward KL  | 66.2     |
| Running Reverse KL  | 881      |
| Running Update Time | 549      |
----------------------------------
--2024-08-11 15:03:21.657444 UTC---
| Itration            | 550       |
| Real Det Return     | 511       |
| Real Sto Return     | 78.8      |
| Reward Loss         | -4.33e+07 |
| Running Env Steps   | 2750000   |
| Running Forward KL  | 66.4      |
| Running Reverse KL  | 978       |
| Running Update Time | 550       |
-----------------------------------
--2024-08-11 15:05:08.006516 UTC---
| Itration            | 551       |
| Real Det Return     | 924       |
| Real Sto Return     | 797       |
| Reward Loss         | -3.46e+07 |
| Running Env Steps   | 2755000   |
| Running Forward KL  | 66.5      |
| Running Reverse KL  | 1.33e+03  |
| Running Update Time | 551       |
-----------------------------------
--2024-08-11 15:06:54.859854 UTC---
| Itration            | 552       |
| Real Det Return     | 957       |
| Real Sto Return     | 811       |
| Reward Loss         | -3.28e+07 |
| Running Env Steps   | 2760000   |
| Running Forward KL  | 54.9      |
| Running Reverse KL  | 978       |
| Running Update Time | 552       |
-----------------------------------
--2024-08-11 15:08:40.678541 UTC---
| Itration            | 553       |
| Real Det Return     | 1.58e+03  |
| Real Sto Return     | 1.62e+03  |
| Reward Loss         | -1.65e+07 |
| Running Env Steps   | 2765000   |
| Running Forward KL  | 47.8      |
| Running Reverse KL  | 570       |
| Running Update Time | 553       |
-----------------------------------
--2024-08-11 15:10:28.840836 UTC---
| Itration            | 554       |
| Real Det Return     | 1.97e+03  |
| Real Sto Return     | 1.55e+03  |
| Reward Loss         | -2.79e+07 |
| Running Env Steps   | 2770000   |
| Running Forward KL  | 50        |
| Running Reverse KL  | 498       |
| Running Update Time | 554       |
-----------------------------------
--2024-08-11 15:12:15.243404 UTC---
| Itration            | 555       |
| Real Det Return     | 1.58e+03  |
| Real Sto Return     | 1.46e+03  |
| Reward Loss         | -2.78e+07 |
| Running Env Steps   | 2775000   |
| Running Forward KL  | 47.8      |
| Running Reverse KL  | 742       |
| Running Update Time | 555       |
-----------------------------------
--2024-08-11 15:14:03.646122 UTC---
| Itration            | 556       |
| Real Det Return     | 1.19e+03  |
| Real Sto Return     | 1.17e+03  |
| Reward Loss         | -3.72e+07 |
| Running Env Steps   | 2780000   |
| Running Forward KL  | 53.2      |
| Running Reverse KL  | 972       |
| Running Update Time | 556       |
-----------------------------------
--2024-08-11 15:15:52.324762 UTC---
| Itration            | 557       |
| Real Det Return     | 1.65e+03  |
| Real Sto Return     | 2.36e+03  |
| Reward Loss         | -2.42e+07 |
| Running Env Steps   | 2785000   |
| Running Forward KL  | 46.8      |
| Running Reverse KL  | 906       |
| Running Update Time | 557       |
-----------------------------------
--2024-08-11 15:17:43.892216 UTC---
| Itration            | 558       |
| Real Det Return     | 2.95e+03  |
| Real Sto Return     | 2.71e+03  |
| Reward Loss         | -1.59e+07 |
| Running Env Steps   | 2790000   |
| Running Forward KL  | 41.1      |
| Running Reverse KL  | 32.7      |
| Running Update Time | 558       |
-----------------------------------
--2024-08-11 15:19:33.333850 UTC---
| Itration            | 559       |
| Real Det Return     | 2.47e+03  |
| Real Sto Return     | 3.22e+03  |
| Reward Loss         | -2.54e+07 |
| Running Env Steps   | 2795000   |
| Running Forward KL  | 42.7      |
| Running Reverse KL  | 1.11e+03  |
| Running Update Time | 559       |
-----------------------------------
--2024-08-11 15:21:22.073384 UTC--
| Itration            | 560      |
| Real Det Return     | 1.76e+03 |
| Real Sto Return     | 2.08e+03 |
| Reward Loss         | -2.6e+07 |
| Running Env Steps   | 2800000  |
| Running Forward KL  | 43.7     |
| Running Reverse KL  | 580      |
| Running Update Time | 560      |
----------------------------------
--2024-08-11 15:23:11.002598 UTC---
| Itration            | 561       |
| Real Det Return     | 2.45e+03  |
| Real Sto Return     | 2.46e+03  |
| Reward Loss         | -2.04e+07 |
| Running Env Steps   | 2805000   |
| Running Forward KL  | 42.1      |
| Running Reverse KL  | 374       |
| Running Update Time | 561       |
-----------------------------------
--2024-08-11 15:25:02.646458 UTC---
| Itration            | 562       |
| Real Det Return     | 2.65e+03  |
| Real Sto Return     | 3.07e+03  |
| Reward Loss         | -2.42e+07 |
| Running Env Steps   | 2810000   |
| Running Forward KL  | 43.3      |
| Running Reverse KL  | 473       |
| Running Update Time | 562       |
-----------------------------------
--2024-08-11 15:26:52.260325 UTC---
| Itration            | 563       |
| Real Det Return     | 3.34e+03  |
| Real Sto Return     | 2.24e+03  |
| Reward Loss         | -1.75e+07 |
| Running Env Steps   | 2815000   |
| Running Forward KL  | 39.1      |
| Running Reverse KL  | 540       |
| Running Update Time | 563       |
-----------------------------------
--2024-08-11 15:28:45.130518 UTC---
| Itration            | 564       |
| Real Det Return     | 3.9e+03   |
| Real Sto Return     | 3.37e+03  |
| Reward Loss         | -1.95e+07 |
| Running Env Steps   | 2820000   |
| Running Forward KL  | 40.7      |
| Running Reverse KL  | 148       |
| Running Update Time | 564       |
-----------------------------------
--2024-08-11 15:30:36.933984 UTC---
| Itration            | 565       |
| Real Det Return     | 3.91e+03  |
| Real Sto Return     | 3.65e+03  |
| Reward Loss         | -9.88e+06 |
| Running Env Steps   | 2825000   |
| Running Forward KL  | 32.4      |
| Running Reverse KL  | 36.3      |
| Running Update Time | 565       |
-----------------------------------
--2024-08-11 15:32:29.699235 UTC---
| Itration            | 566       |
| Real Det Return     | 3.91e+03  |
| Real Sto Return     | 4.28e+03  |
| Reward Loss         | -9.56e+06 |
| Running Env Steps   | 2830000   |
| Running Forward KL  | 34.6      |
| Running Reverse KL  | 38.7      |
| Running Update Time | 566       |
-----------------------------------
--2024-08-11 15:34:24.180393 UTC---
| Itration            | 567       |
| Real Det Return     | 4.57e+03  |
| Real Sto Return     | 4.36e+03  |
| Reward Loss         | -7.66e+06 |
| Running Env Steps   | 2835000   |
| Running Forward KL  | 32.4      |
| Running Reverse KL  | 221       |
| Running Update Time | 567       |
-----------------------------------
--2024-08-11 15:36:16.934775 UTC---
| Itration            | 568       |
| Real Det Return     | 4.05e+03  |
| Real Sto Return     | 3.7e+03   |
| Reward Loss         | -9.26e+06 |
| Running Env Steps   | 2840000   |
| Running Forward KL  | 31.9      |
| Running Reverse KL  | 33.6      |
| Running Update Time | 568       |
-----------------------------------
--2024-08-11 15:38:08.380426 UTC---
| Itration            | 569       |
| Real Det Return     | 3.98e+03  |
| Real Sto Return     | 3.88e+03  |
| Reward Loss         | -1.36e+07 |
| Running Env Steps   | 2845000   |
| Running Forward KL  | 37.1      |
| Running Reverse KL  | 617       |
| Running Update Time | 569       |
-----------------------------------
--2024-08-11 15:40:00.303860 UTC---
| Itration            | 570       |
| Real Det Return     | 3.9e+03   |
| Real Sto Return     | 3.73e+03  |
| Reward Loss         | -1.13e+07 |
| Running Env Steps   | 2850000   |
| Running Forward KL  | 37.1      |
| Running Reverse KL  | 511       |
| Running Update Time | 570       |
-----------------------------------
--2024-08-11 15:41:52.956687 UTC---
| Itration            | 571       |
| Real Det Return     | 4.1e+03   |
| Real Sto Return     | 3.7e+03   |
| Reward Loss         | -1.42e+07 |
| Running Env Steps   | 2855000   |
| Running Forward KL  | 39.3      |
| Running Reverse KL  | 382       |
| Running Update Time | 571       |
-----------------------------------
--2024-08-11 15:43:45.589134 UTC---
| Itration            | 572       |
| Real Det Return     | 4.2e+03   |
| Real Sto Return     | 3.22e+03  |
| Reward Loss         | -1.65e+07 |
| Running Env Steps   | 2860000   |
| Running Forward KL  | 36.4      |
| Running Reverse KL  | 281       |
| Running Update Time | 572       |
-----------------------------------
--2024-08-11 15:45:38.985259 UTC---
| Itration            | 573       |
| Real Det Return     | 4.2e+03   |
| Real Sto Return     | 3.34e+03  |
| Reward Loss         | -1.11e+07 |
| Running Env Steps   | 2865000   |
| Running Forward KL  | 33.7      |
| Running Reverse KL  | 384       |
| Running Update Time | 573       |
-----------------------------------
--2024-08-11 15:47:32.554174 UTC---
| Itration            | 574       |
| Real Det Return     | 4.49e+03  |
| Real Sto Return     | 4.2e+03   |
| Reward Loss         | -8.53e+06 |
| Running Env Steps   | 2870000   |
| Running Forward KL  | 33.4      |
| Running Reverse KL  | 36.7      |
| Running Update Time | 574       |
-----------------------------------
--2024-08-11 15:49:22.897437 UTC---
| Itration            | 575       |
| Real Det Return     | 3.97e+03  |
| Real Sto Return     | 3.44e+03  |
| Reward Loss         | -9.46e+06 |
| Running Env Steps   | 2875000   |
| Running Forward KL  | 32.2      |
| Running Reverse KL  | 485       |
| Running Update Time | 575       |
-----------------------------------
--2024-08-11 15:51:14.804497 UTC---
| Itration            | 576       |
| Real Det Return     | 4.4e+03   |
| Real Sto Return     | 3.68e+03  |
| Reward Loss         | -1.36e+07 |
| Running Env Steps   | 2880000   |
| Running Forward KL  | 34        |
| Running Reverse KL  | 254       |
| Running Update Time | 576       |
-----------------------------------
--2024-08-11 15:53:07.876660 UTC--
| Itration            | 577      |
| Real Det Return     | 4.55e+03 |
| Real Sto Return     | 4.15e+03 |
| Reward Loss         | -8.4e+06 |
| Running Env Steps   | 2885000  |
| Running Forward KL  | 30.1     |
| Running Reverse KL  | 67       |
| Running Update Time | 577      |
----------------------------------
--2024-08-11 15:55:01.303019 UTC---
| Itration            | 578       |
| Real Det Return     | 4.64e+03  |
| Real Sto Return     | 4.3e+03   |
| Reward Loss         | -7.63e+06 |
| Running Env Steps   | 2890000   |
| Running Forward KL  | 33.9      |
| Running Reverse KL  | 33.5      |
| Running Update Time | 578       |
-----------------------------------
--2024-08-11 15:56:55.099522 UTC---
| Itration            | 579       |
| Real Det Return     | 4.49e+03  |
| Real Sto Return     | 4.51e+03  |
| Reward Loss         | -9.95e+06 |
| Running Env Steps   | 2895000   |
| Running Forward KL  | 34.3      |
| Running Reverse KL  | 367       |
| Running Update Time | 579       |
-----------------------------------
--2024-08-11 15:58:48.532231 UTC---
| Itration            | 580       |
| Real Det Return     | 4.36e+03  |
| Real Sto Return     | 4.35e+03  |
| Reward Loss         | -8.07e+06 |
| Running Env Steps   | 2900000   |
| Running Forward KL  | 32.4      |
| Running Reverse KL  | 31        |
| Running Update Time | 580       |
-----------------------------------
--2024-08-11 16:00:42.327045 UTC---
| Itration            | 581       |
| Real Det Return     | 4.53e+03  |
| Real Sto Return     | 4.43e+03  |
| Reward Loss         | -8.06e+06 |
| Running Env Steps   | 2905000   |
| Running Forward KL  | 31.9      |
| Running Reverse KL  | 35.6      |
| Running Update Time | 581       |
-----------------------------------
--2024-08-11 16:02:35.704051 UTC---
| Itration            | 582       |
| Real Det Return     | 4.64e+03  |
| Real Sto Return     | 4.41e+03  |
| Reward Loss         | -1.07e+07 |
| Running Env Steps   | 2910000   |
| Running Forward KL  | 34.8      |
| Running Reverse KL  | 462       |
| Running Update Time | 582       |
-----------------------------------
--2024-08-11 16:04:27.256073 UTC--
| Itration            | 583      |
| Real Det Return     | 3.47e+03 |
| Real Sto Return     | 3.98e+03 |
| Reward Loss         | -1.5e+07 |
| Running Env Steps   | 2915000  |
| Running Forward KL  | 33.6     |
| Running Reverse KL  | 445      |
| Running Update Time | 583      |
----------------------------------
--2024-08-11 16:06:19.931775 UTC---
| Itration            | 584       |
| Real Det Return     | 4.16e+03  |
| Real Sto Return     | 3.61e+03  |
| Reward Loss         | -1.07e+07 |
| Running Env Steps   | 2920000   |
| Running Forward KL  | 37.4      |
| Running Reverse KL  | 343       |
| Running Update Time | 584       |
-----------------------------------
--2024-08-11 16:08:12.439282 UTC---
| Itration            | 585       |
| Real Det Return     | 5e+03     |
| Real Sto Return     | 4.19e+03  |
| Reward Loss         | -1.11e+07 |
| Running Env Steps   | 2925000   |
| Running Forward KL  | 32.4      |
| Running Reverse KL  | 321       |
| Running Update Time | 585       |
-----------------------------------
--2024-08-11 16:10:04.854730 UTC---
| Itration            | 586       |
| Real Det Return     | 4.25e+03  |
| Real Sto Return     | 3.71e+03  |
| Reward Loss         | -1.43e+07 |
| Running Env Steps   | 2930000   |
| Running Forward KL  | 32.8      |
| Running Reverse KL  | 471       |
| Running Update Time | 586       |
-----------------------------------
--2024-08-11 16:11:57.867168 UTC---
| Itration            | 587       |
| Real Det Return     | 4.11e+03  |
| Real Sto Return     | 4.25e+03  |
| Reward Loss         | -9.96e+06 |
| Running Env Steps   | 2935000   |
| Running Forward KL  | 36.9      |
| Running Reverse KL  | 274       |
| Running Update Time | 587       |
-----------------------------------
--2024-08-11 16:13:50.470747 UTC---
| Itration            | 588       |
| Real Det Return     | 4.87e+03  |
| Real Sto Return     | 4.16e+03  |
| Reward Loss         | -7.24e+06 |
| Running Env Steps   | 2940000   |
| Running Forward KL  | 29.2      |
| Running Reverse KL  | 209       |
| Running Update Time | 588       |
-----------------------------------
--2024-08-11 16:15:43.991447 UTC---
| Itration            | 589       |
| Real Det Return     | 4.99e+03  |
| Real Sto Return     | 4.31e+03  |
| Reward Loss         | -1.31e+07 |
| Running Env Steps   | 2945000   |
| Running Forward KL  | 33.9      |
| Running Reverse KL  | 550       |
| Running Update Time | 589       |
-----------------------------------
--2024-08-11 16:17:36.884593 UTC--
| Itration            | 590      |
| Real Det Return     | 4.55e+03 |
| Real Sto Return     | 4.65e+03 |
| Reward Loss         | -7.2e+06 |
| Running Env Steps   | 2950000  |
| Running Forward KL  | 34.5     |
| Running Reverse KL  | 37.6     |
| Running Update Time | 590      |
----------------------------------
--2024-08-11 16:19:28.426038 UTC---
| Itration            | 591       |
| Real Det Return     | 4.28e+03  |
| Real Sto Return     | 3.97e+03  |
| Reward Loss         | -6.91e+06 |
| Running Env Steps   | 2955000   |
| Running Forward KL  | 33.3      |
| Running Reverse KL  | 27.3      |
| Running Update Time | 591       |
-----------------------------------
--2024-08-11 16:21:21.171752 UTC---
| Itration            | 592       |
| Real Det Return     | 4.86e+03  |
| Real Sto Return     | 4.27e+03  |
| Reward Loss         | -6.24e+06 |
| Running Env Steps   | 2960000   |
| Running Forward KL  | 30.2      |
| Running Reverse KL  | 23.1      |
| Running Update Time | 592       |
-----------------------------------
--2024-08-11 16:23:14.720396 UTC--
| Itration            | 593      |
| Real Det Return     | 4.76e+03 |
| Real Sto Return     | 4.55e+03 |
| Reward Loss         | -6.4e+06 |
| Running Env Steps   | 2965000  |
| Running Forward KL  | 33.5     |
| Running Reverse KL  | 29.5     |
| Running Update Time | 593      |
----------------------------------
--2024-08-11 16:25:09.099658 UTC---
| Itration            | 594       |
| Real Det Return     | 5.07e+03  |
| Real Sto Return     | 4.82e+03  |
| Reward Loss         | -4.59e+06 |
| Running Env Steps   | 2970000   |
| Running Forward KL  | 33.4      |
| Running Reverse KL  | 33.4      |
| Running Update Time | 594       |
-----------------------------------
--2024-08-11 16:27:01.358671 UTC--
| Itration            | 595      |
| Real Det Return     | 4.87e+03 |
| Real Sto Return     | 3.48e+03 |
| Reward Loss         | -1.1e+07 |
| Running Env Steps   | 2975000  |
| Running Forward KL  | 34.1     |
| Running Reverse KL  | 275      |
| Running Update Time | 595      |
----------------------------------
--2024-08-11 16:28:54.507052 UTC---
| Itration            | 596       |
| Real Det Return     | 4.87e+03  |
| Real Sto Return     | 4.89e+03  |
| Reward Loss         | -9.75e+06 |
| Running Env Steps   | 2980000   |
| Running Forward KL  | 34.9      |
| Running Reverse KL  | 221       |
| Running Update Time | 596       |
-----------------------------------
--2024-08-11 16:30:48.799736 UTC---
| Itration            | 597       |
| Real Det Return     | 4.96e+03  |
| Real Sto Return     | 4.76e+03  |
| Reward Loss         | -6.56e+06 |
| Running Env Steps   | 2985000   |
| Running Forward KL  | 28.5      |
| Running Reverse KL  | 30        |
| Running Update Time | 597       |
-----------------------------------
--2024-08-11 16:32:42.057797 UTC---
| Itration            | 598       |
| Real Det Return     | 4.86e+03  |
| Real Sto Return     | 4.84e+03  |
| Reward Loss         | -1.05e+07 |
| Running Env Steps   | 2990000   |
| Running Forward KL  | 30.7      |
| Running Reverse KL  | 451       |
| Running Update Time | 598       |
-----------------------------------
--2024-08-11 16:34:35.232989 UTC---
| Itration            | 599       |
| Real Det Return     | 4.69e+03  |
| Real Sto Return     | 4.41e+03  |
| Reward Loss         | -9.01e+06 |
| Running Env Steps   | 2995000   |
| Running Forward KL  | 32.3      |
| Running Reverse KL  | 233       |
| Running Update Time | 599       |
-----------------------------------
